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(57) In an optical disc on whichi image signals of 
high resolution are recorded and a system for reproduc- 
ing thereof, compatibility with a conventional system for 
reproducing image signals of normal resolution is to be 
realized. Image signals of high resolution are divMed 
into a main signal and an auxiliary signal by an image 
separating member, and a first interleave bkx^ (54) and 
a second interleave block (55) formed by dividing each 
MPEG-coded stream into groups of frames of one GOP 
or more are alternately recorded on an optical disc (1). 
In a reproducing devk:e capable of handling high resolu- 
tion, both the first and the second interleave blocks are 
reproduced, thus providing an image of high resolution. 
On the other hand, in a reproducing device incapable of 
handling high resolution, only one of the first and the 
second interleave blocks is reproduced, thus providing 
an image of normal resolution. 
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Description 

TECHNICAL FIELD 

(0001 ] The present invention relates to an optical disk 
having a three-dimensional (3D) picture and a high def- 
inition picture stored thereon, and an apparatus for 
recording data to or reproducing data from the optical 
disk. 

BACKGROUND ART 

[0002] A conventionally known optical disk having a 
3D moving picture stored thereon is as shown In Rgure 
10. An optical disk 201 has a picture for the right eye 
(right-eye picture) stored in even fields 204, 2D4a and 
204b and a picture for the left eye (left-eye picture) 
stored in odd fields 203. 203a and 203b. The right-eye 
picture and the left-eye picture are recorded alternatety 
When the data stored on the optical disk 201 is repro- 
duced by an existing optical disk reproduction appara- 
tus 205 shown in Figure 11, a right-eye picture and a 
lelt-eye picture appear on a TV screen 206 alternately 
every 1/60 second. The naked eye recognizes only a 
picture in which the right-eye picture and the left-eye 
picture are overlapped. With 3D spectacles 207. in 
which a shutter for the right-eye picture and a shutter for 
the left-eye picture are »vitched over every 1/60 sec- 
ond, a 3D picture is recognized. As shown in Figure 12, 
a right-eye picture and a left-eye picture are each 
encoded alternately in every other field as an interlace 
signal In 1 GOP of an MPEG signal. 
[0003] For high definition pictures, progressive sys- 
tems referred to as 525P and 720P have been studied. 
[0004] A first problem of the conventional art will be 
described. When data in a conventional 3D optical disk 
is reproduced by an ordinary, conventional 2D repro- 
duction apparatus, even a non-3D picture, I.e., even a 
2D picture is not output. Data in the 3D optical disk is 
only reproduced by a reproduction apparatus con- 
nected to a 3D display. /Accordingly, it is required to cre- 
ate two types of optical disks, i.e., a 3D optica) disk and 
a 2D optical disk for the same contents . The same is 
true witti the high definitton picture. In other words, the 
conventional 3D and high definition optical disks are not 
compatible with ordinary optical disks. A first objective 
of the present invention is to provide a 3D or high defini- 
tion optical disk which is compatible with ordinary opti- 
cal disks, and a reproduction system for the 3D or high 
definition optical disk. 

[0005] The term "compatibility" is clearly defined as 
similar to the compatibility between monaural records 
and stereo records discussed in the past. In other 
words, data in a novel 3D or high resolution disk accord- 
ing to the present invention is output as a "monaural" 
vision. i.e., as a 2D picture or an ordinary resolution pic- 
ture by an existing reproduction apparatus developed 
for DV[)s or the like, and is reproduced as a "stereo" 



vision, i.e., a 3D picture or a high resolution picture by 
the novel reproduction apparatus according to the 
present invention. 

[0006] A second problem of the conventional art con- 
5 cerns a synchronization system. According to a conven- 
tional synchronization system, decoding starts when 
decoding conditions for each compressed video signal 
are provided. The conventional synchronization system 
has problems in that for example, when the data 
10 becomes out of synchronization for some reason during 
reproduction, compensation is not performed; and that 
audio data is not synchronized. 
[0007] A second objective of the present invention is 
to provide a reproduction apparatus for reproducing a 
75 plurality of compressed video signals or a plurality of 
compressed audio signals in synchronization with one 
another and performing compensation when the data 
becomes out of synchronization during reproduction. 

20 DISCLOSURE OF INVEfNtTION 

[0008] TTie present invention includes the folicwing 
means to achieve the above-described objectives. 
[0009] An optical disk according to the present inven- 

25 tion is obtained in the following manner. Two moving pic- 
tures each having a frame rate of 30 frames/sec. are 
input. A plurality of frames of each picture, which con-e- 
spond to 1 GOP or more of the disK are set as a picture 
unit. These pfoture units of the two pictures are 

30 arranged on the optical disk alternately as interleave 
blocks. Each interleave block coresponds to one rota- 
tion or more. The two moving pictures can be. for exam- 
ple, a picture for the right eye and a picture for the left 
eye; or Includes field components of a progressive pic- 

35 ture. 

[001 0] When such an optical disk is reproduced by an 
ordinary reproduction apparatus for two-dimensional 
(2D) display, an ordinary two-dimenstonal is repro- 
duced. 

40 [001 1 ] A reproduction apparatus for 3 D and high def- 
inition pictures according to tiie present invention 
includes means for reproducing picture identification 
infonmation from an optical disk, means for reproducing 
a two-dimensional pfoture in a conventional process. 

45 means for reproducing a 3D or high definition picture, 
and means for outputting the 3D or high definition pic- 
ture. 

[0012] The present invention includes the following 
means to achieve the second objective. 

50 [0013] A reproduction apparatus according to the 
present invention includes reference time signal gener- 
ation means for generating a reference time signal; and 
a plurality of picture extension/lreproduction means hav- 
ing a function of extending a compression video stream 

55 and controlling reproduction time of the extended video 
signal in accordance with tiie difference between the 
reference time signal and the picture reproduction time 
information. 
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[0014] Another reproduction apparatus according to 
the present invention includes a plurality of picture 
extension/reproduction means having a function of gen- 
erating a reference time signal, extending a compres- 
sion video stream and controlling reproduction time of s 
the extended video signal in accordance with the differ- 
ence between the reference time signal and the picture 
reproduction time information. The reference time sig- 
nals in the plurality of picture extension/reproduction 
means are corrected using identical information at sub- 
stantially the same time. 

[0015] Still another reproduction apparatus according 
to the present invention includes reference time signal 
generation means for generating a reference time sig- 
nal; and a plurality of audio extension/reproduction 
means having a function of extending a compression 
audio stream and controlling reproduction time of the 
extended audio signal in accordance with the difference 
between the reference time signal and the audio repro- 
duction time information. 

[001 6] Yet another reproduction apparatus according 
to the present invention controls reproduction time by 
Changing the frequency of the clock by which the audio 
extension/reproduction nteans performs extension and 
reproduction. 

BRIEF DESCRIPTION OF DRAWINGS 
[0017] 

Figure 1 is a block diagram showing a recording 
apparatus in one example according to the present 
invention. 

Figure 2 is a timing diagram showing the relation- 35 
ship between an input signal and a recording signal 
in one example according to the present invention. 

Figure 3 is a lop view of an optical disk showing the 
interleave block arrangement in one example 40 
according to the present invention. 

Figure 4 is a view illustrating 3D pk:ture arrange- 
ment information one example according to the 
present invention. 45 

Figure 5 is a view showing a reproduction appara- 
tus in one example according to the present inven- 
tk)n. 

so 

Figure 6 is a timing diagram illustrating the relation- 
ship between a recorded signal and a picture output 
signal in a reproduction apparatus in one example 
according to the present invention. 

55 

Figure 7 is a block diagram showing an MPEG 
decoder of a different system of a reproduction 
apparatus in one example according to the present 



invention. 

Rgure 8 is a timing diagram showing the relation- 
ship between a recording signal and an output sig- 
nal when 2D reproduction is performed with a 
reproduction apparatus in one example according 
to the present inventkm. 



Figure IS is a flowchart (I) illusti^ating how a proc- 
ess of accessing a pointer is changed in accord- 
ance witii whether a 3D vkleo signal is reproduced 
or not in one example according to the present 
invention. 

Rgure 16 is a flowchart (IQ illustrating how a proc- 
ess of accessing a pointer is changed in accord- 
ance with whether a 3D video signal is reproduced 
or not in one example according to the present 
invention. 

Rgure 17 is a flowchart showing how the manner of 
output is changed in accordance with whether the 
signal to be reproduced is a 3D video signal or not 
by a 3D reproduction apparatus in one example 
according to the present inventk)n. 

Rgure 18 is a view showing a 3D picture identifier in 
a 3D picture logical an-angement table in one exam- 
ple according to the present invention. 

Rgure 1 9 is a flowchart showing a metiiod for spec- 



Rgure 9 is a block diagram showing a 2D reproduc- 
10 tion apparatus in one example according to the 
present invention. 

Rgure 10 is a top view showing data arrangement 
of a conventional optical disk having a 3D picture. 

IS 

Rgure 11 is a block diagram showing a reproduc- 
tion apparatus for reproducing a conventional opti- 
cal disk having a 3D picture. 

20 Rgure 1 2 is a timing diagram showing the relation- 
ship between a recording signal obtained by repro- 
ducing a conventional optical disk having a 3D 
picture and a picture output signal. 

25 Rgure 1 3 is a timing diagram showing the relation- 
ship among a virtual 3D identifier, an R output and 
an L output in one example according to the 
present invention. 

30 Rgure 14 is a reproduction sequence view showing 
tiie difference of f pointer accessing in an ordinary 
picture reproduction mode and a 3D reproduction 
mode in one example according to tiie present 
invention. 
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tfying the attribute of each chapter, cell arxJ inter- 
leave block of a 3D picture based on a 3D picture 
identifier in the 3D picture logical arrangement table 
in one example according to the present invention. 

5 

Figure 20 is a block diagram of a reproduction 
apparatus in an interlace picture signal output 
mode in one example according to the present 
invention. 

10 

Figure 21 is a block diagram of a reproduction 
apparatus in a progressive picture signal output 
mode in one example according to the present 
Invention. 

15 

Figure 22 is a block diagram of a recording appara- 
tus In a progressive picture signal input mode in 
one example according to the present invention. 

Figure 23 is a view illustrating the principle of mutti- 20 
pie angle video data division multiplex system in 
one example according to the present invention. 

Figure 24 is a block diagram of a reproduction 
apparatus in a 3D picture signal reproduction mode 25 
in one example according to the present invention. 

Figure 25 is a btock diagram of a 4X reproduction 
apparatus in a 3D progressive picture signal repro- 
duction mode in one example according to the 30 
present invention. 

Figure 26 is a block diagram of a reproduction 
apparatus In a multi-stream progressive picture sig- 
nal reproduction mode in one example according to 3S 
the present invention. 

Figure 27 is a view illustrating a data structure of 
the entire optical disk in one example according to 
the present Invention. 4o 

Figure 28 is a view illustrating an inner structure of 
a volume information file in Rgure 27 in one exam- 
ple according to the present Inverttion. 

45 

Figure 29 is a flowchart showing a detailed process 
for reproducing a program chain group b/ a system 
control section Ml -9 In one example according to 
the present invention. 

50 

Figure 30 is a block diagram showing a structure of 
a part of an AV synchronization control 12-10, the 
part performing AV synchronization. In one exam- 
ple according to the present invention. 

55 

Figure 31 is a timing diagram showing a data 
stream which is reproduced and output through a 
buffer of the decoder in one example according to 



the present invention. 

Rgure 32 is a view illustrating a method for reduc- 
ing interlace Interference by turning on or off a filter 
in one example according to tiie present invention. 

Rgure 33 is a view Illustrating the principle of an 
encoding system using a common motion detecting 
vector in one exanple according to the present 
invention. 

Rgure 34 is a view illustrating a metiiod for adjust- 
ing the timing for reproducing data from a DVD disk 
in one example according to the present invention. 

Rgure 35 is a timing diagram showing reproduction 
of an interleave block when one video sti'eam is 
switched to another in one example according to 
the present invention. 

Rgure 36 is a view illustrating the principle of 
recording two progressive video signals after divid- 
ing them into interleave blocks in one exanple 
according to the present invention. 

Rgure 37 is a flowchart showing a metiiod for skip- 
ping a first dummy field of a VOB in one example 
according to the present invention. 

Rgure 38 is a flowchart illustrating a process of 
STC switching for seamless connection in one 
example according to the present invention. 

Rgure 39 Is a block diagram of data decoding in 
one example according to the present Invention. 

Rgure 40 is a view illustrating tiie principle of divid- 
ing a scope (wide) ptoture in a horizontal direction 
and recording tiie resultant signals as Interleave 
blocks in one example according to the present 
invention. 

Rgure 41 is a view illustrating the principle of syn- 
tfiesizing a scope (wide) picture from an optical disk 
having the scope picture in a divided State and 
processing tiie syntiiesized picture witii 3-2 titans- 
form in one example according to flie present 
invention. 

Rgure 42 is a sti-uctural view of a system stream 
and video data on an optical disk in one example 
according to the present inventton. 

Rgure 43 is a flowchart for seamless connection In 
one example according to the present invention. 

Rgure 44 is a view illustrating a method for dividing 
interpolation information in horizontal and vertical 
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directions and recording the resultant signals in 
interleave blocks in one example according to the 
present invention. 

Figure 45 is a timing diagram of reproduction of pro- s 
gressive, 3D and wide signals with respect to the 
data amount in buffer in one example according to 
the present invention. 

Figure 46 is a structural view of a horizontal filter io 
and a vertical filter in one example according to the 
present invention. 

Figure 47 is a block diagram of a reproduction 
apparatus which shares a common motion vector is 
signal and color information in one example accord- 
ing to the present invention. 

Figure 48 is a view illustrating the principle of 
motion detection of a progressive picture using a 20 
motion detection vector in one example according 
to the present invention. 

Figure 49 shows a signal format of a picture identi- 
fier in one example according to the present inven- 2S 
tion. 

Rgure 50 shows contents of a vertical filter and a 
horizontal filter in one example according to the 
present invention. so 

Figure 51 is a view illustrating the principle of divid- 
ing and recording a 1050 interlace signal in one 
example according to the present invention. 

35 

Figure 52 is an arrangement view for outputting a 
progressive signal, an NTSC signal and a HDTV 
signal in one example according to the present 
invention. 

40 

Figure 53 is a view showing a progressive repro- 
duction method for reproducing an interleave block 
while refen-ing to a video presentation time stamp in 
one example according to the present invention. 

45 

Figure 54 is an arrangement view of an HDTV sub 
signal and an NTSC signal by simultaneous casting 
in one example according to the present invention. 

Figure 55 is a block diagram of a reproduction so 
apparatus for an HDTV/NTSC disk by simultaneous 
casting in one example according to the present 
invention. 

Figure 56 is a flowchart illustrating a method for ss 
controlling two buffers in one example according to 
the present Inventfon. 



Figure 57 is a flowchart illustrating a method for 
performing AV synchronization of a first decoder 
and a second decoder in one example according to 
the present invention. 

Rgure 58 is a view illustrating the principle of an 
MADM system for dividing a signal into two in a hor- 
izontal direction in one example according to the 
present invention. 

In Figure 59. (a) Is a view illustrating processing of 
an entirety of a horizontal filter circuit in one exam- 
ple according to the present invention, and (b) is a 
view illustrating processing of each line of the hori- 
zontal filter circuit in one example according to the 
present invention. 

Rgure 60 is a block diagram of a system for dividing 
a scope-size picture into two in a horizontal direc- 
tion and recording in the MADM system in one 
example according to the present invention. 

Rgure 61 is a view illustrating tiie principle of a pro- 
vider defined stream multiplex system (vertical divi- 
sion) in one example according to the present 

invention. 

Rgure 62 is a view illustrating the principle of a pro- 
vider defined stream multiplex system (horizontal 
division) in one example according to the present 

invention. 

Rgure 63 shows a signal format of provider defined 
stream multiplex system in one example according 
to the present invention. 

Rgure 64 is a block structural view of an optical disk 
reproduction apparatus in one example according 
to the present invention. 

Rgure 65 is a structural view of a video decoder in 
one example according to the present invention. 

Rgure 66 shows a data structure of an optical disk 
in one example according to the present invention. 

Rgure 67 is a timing diagram of video reproduction 
in one example according to tiie present invention. 

Rgure 68 is a t>lock structural view of an optical disk 
reproduction apparatus in one example according 
to the present invention. 

Rgure 69 is a structural view of an audio decoder in 
one example according to the present invention. 

Rgure 70 shows a data structure of an optical disk 
in one example according to tiie present invention. 
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Figure 71 is a timing diagram of audio and video 
reproduction in one example according to the 
present invention. 

Figure 72 shows an optical disk reproduction appa- s 
ratus in one example according to the present 
invention. 

Figure 73 is a structural view of a video decoder in 
one example according to the present invention. io 

Figure 74 is a timing diagram of video reproduction 
in one example according to the present invention. 

Figure 75 is a block sti-uctural view of an optical disk is 
reproduction apparatus in one example according 
to the present invention. 

Figure 76 is a structural view of a video decoder in 
one example according to tiie present invention. 20 

Figure 77 is a structural view of a video decoder in 
one example according to tiie present invention. 

Figure 78 is a structural view of a video decoder in 2S 
one example according to the present invention. 

Figure 79 is a block structural view of an optical disk 
reproduction apparatus in one example according 
to the present invention. so 

Figure 80 is a structural view of an audio decoder in 
one example according to tiie present invention. 

Figure 81 shows a data structure of an optical disk 3S 
in one exarrple according to the present invention. 

Figure 82 is a timing diagram of audio and video 
reproduction in one example according to the 
present invention. 4o 

Figure 83 is a timing diagram of operation frequen- 
cies of audio and video reproduction in one exam- 
ple according to the present invention. 



Figure 84 is a timing diagram of operation frequen- 
cies of audio and video reproduction in one exam- 
ple according to tiie present inventton. 

Figure 85 is an IP structural view of an MADM 
stream in one example according to the present 
invention. 

Figure 86 shows a method tor preventing a conven- 
tional reproduction apparatus from outputting a sub 
picture signal in one exarriple according to the 
present invention. 
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Rgure 87 shows simulation calculation results 
showing a buffer amount required for simultaneous 
reproduction in one example according to the 
present invention. 

Figure 88 is an arrangement view of continuous 
blocks and interleave blocks in one example 
according to the present invention. 

Figure 89 is an arrangement view of interleave 
blocks in one example according to the present 
inventton. 

Rgure 90 is a block diagram of multiple (2) screen 
in one example according to tiie present invention. 

Rgure 91 is a view illustrating tiie principle of divid- 
ing a high resolution video signal in a horizontal 
direction to obtain two streams, recording the 
streams, synthesizing the two streams to reproduce 
the high resolution video signal (luminance signal) 
in tiie first example according to the present inven- 
tion. 

Rgure 92 is a view illustrating the principle of divid- 
ing a high resolution video signal in a horizontal 
direction to obtain two streams, recording the 
streams, synthesizing the two strearns to reproduce 
tiie high resolution video signal (color signal) in the 
first example according to the present invention. 

Rgure 93 is a flowchart illusti'ating the compatibility 
when an MADM disk in the first example according 
to tiie present invention is reproduced by a conven- 
tional reproduction apparatus. 

Rgure 94 is a flowchart illusti'ating an operation of 
reproducing an MADM disk in tiie first exanf¥>le 
according to the present invention by an MADM 
reproduction apparatus. 

In Figure (a) is a view illustrating an accessing 
process using a pointer of first reproduction infor- 
mation when an MADM disk in the first example 
according to the present invention is reproduced by 
a conventional reproduction apparatus, and (b) is a 
view illusti'ating an accessing process using second 
reproduction information when an MADM disk in 
tiie first example according to the present invention 
is reproduced by an MADM reproduction appara- 
tus. 

Rgure 96 is a block diagram of a reproduction 
apparatus for synthesizing two streams in the first 
eocample according to the present inventfon. 

Rgure 97 is a block diagram of a system for repro- 
ducing two streams obtained by being divided on a 
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frame-by-frame basis and synthesizing the streams 
in a time axis in the first example according to the 
present invention. 

Figure 98 is a block diagram of a recording appara- 
tus and a reproduction apparatus for dividing a pro- 
gressive video signal into two streams and 
synthesizing the signals into the progressive video 
signal in the first example according to the present 
invention. 

BEST MODE FOR CARRYING OUT THE INVENTION 

[001 8] The best mode of the present invention will be 
desaibed with reference to the figures. 
[001 9] In this specification, a recording and reproduc- 
tion system for simultaneously reproducing a plurality of 
streams according to the present invention will be 
refenred to as an "MADM" system. 
[0020] In the first example of the present invention, a 
method for recording and reproducing a 3D picture and 
a high definition picture will be first described, and then 
a method for realizing the high definition picture will be 
described, both as applications of the MADM system 
according to the present invention. In the second 
through eighth examples, practical methods for syn- 
chronization used for reproducing data according to the 
MADM system will be desaibed. 

(Example 1) 

[0021] According to the present invention, a 3D pic- 
ture and a wide screen picture are recorded in the state 
where the picture is divided into two pictures of a right- 
eye picture and a left-eye picture, or divided into two 
screen pictures separated from each other along a hor- 
izontal line. These two pictures are field pictures starting 
from an odd line, and e signal representing such a field 
picture Is referred to as an Odd First signal. A progres- 
sive picture is recorded as being divided into two screen 
pictures separated from each other along a vertical line. 
These two screen pictures are represented by a field 
signal starting from an odd line and a field signal start- 
ing from an even line. These signals are referred to as 
an Odd First signal and an Even First signal. In this 
specification, a recording unit of picture information of 1 
OOP or nnore which has been processed with interleav- 
ing is refen-ed to as an interleave block or a frame group. 
The system according to the present invention is 
referred to as a multiple angle video data division multi- 
plex (MADM) system. 

[0022] Rgure 1 is a btock diagram of an MADM sys- 
tem recording apparatus 2 for an optical disk according 
to the present invention. A progressive signal and a 3D 
signal can both be recorded. A right-eye signal of the 3D 
picture is referred to as an R-TV signal, and a left-eye 
signal is refen-ed to as an L-TV signal. The R-TV signal 
and the L-TV signal are compressed into MPEG signals 



by MPEG encoders 3a and 3b. As a result, an R-MPEG 
signal and an L-MPEG signal as shown in part (2) of 
Figure 2 are obtained. These signals are processed 
with interleaving by an interleave circuit 4. so that an R- 

5 frame group 6 including R-frames 5 corresponding to 1 
GOP or more of the R-MPEQ signal and an L-frame 
group 8 including L-frames 7 corresponding to 1 GOP or 
more of the L-MPEG signal are alternately arranged as 
shown in part (3) of Rgure 2. The recording unit is 

10 referred to as an interleave block, and may also be 
referred to as a frame group in this specification. The R- 
frame group 6 and the L-frame group 8 include an iden- 
tical number of frames having an identical time period, 
so that the right-eye signal and the left-eye signal are 

15 synchronized with each other when being reproduced. 
The frame group is also refen-ed to as a picture data 
unit. One picture data unit coresponds to 0.4 to 1 sec- 
ond. A rotation speed of a DVD is 1440 rpm. i.e.. 24 Hz 
along the innemiost track. Accordingly, an interleave 

20 block corresponds to one or more rotations or further, 
10 to 20 rotations as shown in part (4) of Rgure 2. 
Returning to Rgure 1, address information is output 
from an address circuit 13. Progressive/3D picture 
arrangement information is output from a progres- 

25 sive^D picture arrangement information output section 
10. These pieces of information are recorded on the 
optical disk by a recording circuit 9. The progressive/3D 
pk:ture arrangement information includes an identifier 
which indicates whether or not a progressive or 3D pic- 

30 ture is present on the optical disk, or a progressive/3D 
picture anangement table 14 shown in Figure 4. As 
shown in Figure 4. a TEXTDT file 83 includes, for each 
VTS, 3D pictures for the right and left eyes and angle 
numbers and cell numbers in which the progressive sig- 

35 nal is located. Since a PGC file of each VTS includes a 
starting address and a termination address of each cell, 
the starting address and the termination address of 
each cell are Included in the progressive/3D picture 
arrangement information. Based on the arrangement 

40 information and Identification information, the reproduc- 
tion apparatus outputs a progressive picture or a 3D pic- 
ture con-ectly as progressive outputs or R and L outputs. 
When ordinary pictures of different contents from each 
other are output as R and L outputs in error, the user will 

45 feel uncomfortat>le since the pictures for the right eye 
and the left eye are not related to each other. The pro- 
gressive/3D picture arrangement Information or pro- 
gressive/3D picture Identifier have an effect of avoiding 
the output of such unpleasant pictures. The manner of 

so using the progressive/3D picture arrangement informa- 
tion and progresslve/3D picture identifier will be 
described in detail later together with a description of 
the reproduction apparatus. 

[0023] In the recording apparatus shown in Figure 1 , 
55 a 525P or other progressive signal can be recorded with 
multiple angles. Specifically, a progressive signal is 
divided into a sum component and a difference compo- 
nent by a division section 38, thereby creating two inter- 
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lace signals. The two interlace signals are encoded by 
the two MPEG decoders 3a and 3b. In this case, a 
VPTS which Is synchronized with an APIS of an audio 
signal is provided to a first MPEQ signal and a second 
MPEG signal by a VPTS provision section 81 . Such pro- 5 
vision will be desaibed in detail later. 
[0024] A specific method for creating 3D picture 
arrangenient information will be described. A DVD-for- 
mat optical disk has files of a directory or table of con- 
tents stored in a standardized manner in a recording 10 
starting area thereof. However, these files do not 
include any desaiption on 3D pictures. Accordingly, a 
3D picture logical arrangement file 53 including a 
3D/PG picture logical an^ngement table shown in Fig- 
ure 18 is provided, so that a reproduction apparatus 
conforming to 3D reproduction reads the file. An ordi- 
nary 2D reproduction apparatus cannot read the 3D/PQ 
picture logical arrangement file 53 but provides no prob- 
lem since such an ordinary 2D reproduction apparatus 
does not reproduce a 3D picture. 
[0025] Hereinafter, tiie table in Figure 18 will be 
described. DVD video information includes a three-layer 
logical hierarchy. The three layers are a video title set 
(VTS) layer representing a movie or other work, a part 
of video title (PVT) layer representing a chapter in the 
titie, and a cell (Cell) layer representing a sb-eam in the 
chapter. 

[0026] The arrangement of 3D pictures in each layer 
win be described. "000" indteates that tiiere is no 3D or 
progressive cell; "110" indicates that all cells are 3D 
cells: and "001" indicates that there are 3D cells and 
non-3D cells. 

[0027] in Rgure 1 8. regarding the VTS layer, the sta- 
tus of title 1 is "001 i.e.. the VTS layer of titie 1 includes 
both 3D and ordinary cells. The status of title 2 is "110": 
i.e., all the cells in the VTS layer of titie 2 are 3D ceils. 
The status of titie 3 Is "000": i.e.. there are no 3D cells in 
the VTS layer of titie 3. Accordingly, information on 3D 
pictures is not necessary regarding the lower layers of 
tities 2 and 3. 

[0028] Regarding PVT layer of title 1. the status of 
chapter 2 is "000"; i.e., tiiere are no 3D cells in the PVT 
layer of chapter 2. The status of chapter 3 is "1 10"; i.e., 
all the cells are 3D cells In the PVT layer of chapter 3. 
The status of chapter 1 is "001"; i.e., tiiere are botii 3D 
cells and the ordinary cells in the PVT layer of chapter 
1. Regarding the cell layer of chapter 1, cells 1 and 2 
corespond to R and L data of a first stream. Cells 3 and 
4 correspond to R and L data of a second stream. In 
cells 5 and 6, ordinary pictures are recorded. In the 
embodiment where tfie 3D/PG picture logical arrange- 
ment file 53 is separately recorded on tiie optical disk in 
this manner, the conventional file is not altered. Accord- 
ingly, compatibility between the 3D/PG pictures and the 
ordinary pictures is realized. The logical information 
reveals all tiie physical information on ttie optical disk. 
Accordingly, a malfunction of displaying ordinary pic- 
tures of two different contents for the right eye and the 



left eye is prevented. Moreover, tiie 3D picture can be 
appropriately reproduced and decoded so that R and L 
data are provided to the right eye and the left eye from 
the correct output sections. 

[0029] With reference to the flowchart of Figure 1 9. a 
process for determining whetiier or not each cell 
includes a 3D or progressive picture based on the 
3D/PG picture logical arrangement table 52 will be 
described. In step 51a, tiie 3D/PG picture logical 
arangement table 52 is read from a first recording area 
of the optical disk. In step 51 b, the VTS layer of titie n as 
shown in Figure 18 is checked. When the status of the 
VTS layer is "000", it is determined that no 3D or pro- 
gressive cell is included and tiius 3D processing is not 
performed. When VTS=1 10 in step 51c, all the cells are 
processed as 3D cells in step 51 d. In step 51 e, odd cells 
are processed as including a left-eye picture and even 
cells are processed as including a right-eye pk;ture. In 
step 51f, a menu screen is caused to indtoate tiiat all tiie 
cells in title n are 3D cells. When VTS=001 in step 51 g. 
tiie arrangement information of chapter n of tiie lower 
layer is checked in step 51 1. When PVT^OOO in step 51 J, 
it is detenmined ttiat chapter n include no 3D or PG cells 
in step 51k. When PVT^IIO in step 51 m, it is deter- 
mined ttiat all the cells in chapter n are 3D cells in step 
51 n. Then, the processing goes to step 51 d. where the 
menu screen indicates that tiie all the cells in chapter n 
are 3D cells. When PVT^OOI In step 51 p, each of tiie 
cells in that chapter is checked. When CellsOOO in step 
51s regarding one cell, it is determined that ttie cell is 
not a 3D cell and the processing goes back to step 51 q. 
When Cell=m-R in step 51 u, it is determined that the 
cell corresponds to R data of stream m in step 51 v. 
When Cell=m-L in step 51 w, it is determined tiiat the 
cell corresponds to L data of sti-eam m in step Six. 
Then, ttie next cell is checked in step 51 q. 
[0030] In the embodiment where the 3D/PG picture 
logical arrangement table 52 is additionally recorded in 
tills manner, it is effectively determined whetiier or not 
each of all ttie video titles, chapters and cells includes 
3D data. PG data or neither of such data. 
[0031] This will be described witti respect to ttie top 
view ol the optical disk in Figure 3. An optical disk 1 has 
one spiral track formed therein. The R-frame group 6 is 
recorded on a plurality of R tracks 11, 11a and lib. In 
actuality, tiie R-frame group 6 is recorded on 5 to 24 
tiracks. The L-frame group 8 is recorded on L tracks 1 2, 
1 2a and 1 2b, and ttie next R-frame group 6a is recorded 
on R tracks lie. lid and 1le. 
[0032] Hereinafter, a reproduction operation will be 
described with reference to the block diagram of ttie 3D 
reproduction apparatus according to the present Inven- 
tion in Figure 5 and the timing diagram in Figure 6. 
When a signal from the optical disk 1 is reproduced by 
an optical head 15 and an optical signal reproduction 
circuit 24 and a 3D picture identifier is detected by a 3D 
picture anangement information reproduction section 
26. or when picture data which has been determined to 
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have a 3D picture based on a 3D picture arrangemerrt 
table 14 shown in Rgure 4 is to be reproduced and an 
input section 19 or the like issues an instruction to out- 
put a 3D picture; a switch section 27 is controlled so that 
an R signal and an L signal are output from an R output s 
section 29 and an L output section 30 and so that the R 
and L signals are output alternately on a field-by-field 
basis from an RL mixture circuit 28. The control of the 
switch section 27 is performed simultaneously with the 
processing of the 3D picture. 

[0033] With reference to Figures 5 arKi 6, an operation 
fa reproducing a 3D picture will be described. As 
described with reference to part (3) of Figure 2. the R- 
frame group 6 and the L-frame group 8 are alternately 
recorded on the optical disk. The R-frame group 6 and 
the L-frame group 8 each Include frames corresponding 
to n QOPs. where n is an integer of one or more. Figure 
85 represents such a state in detail. Two (right and left) 
streams are recorded on the disk alternately. Each 
stream includes intra-frame encoded frame data repre- 
sented as I and inter-frame encoded frame data repre- 
sented as B or P, and is divided into interleave units with 
the intra-frame encoded frame as a disconnection point. 
[0034] In Figure 6, part (1) shows the entirety of the 
disk, and part (2) shows a part thereof. An output signal 
from an optical signal reproduction circuit 24 in Figure 5 
is represented as part (2) of Figure 6. The signal is 
divided Into an R signal and an L signal by a switch sec- 
tion 25, and the time axes of the R signal and the L sig- 
nal are matched to an original time axis respectively by 
a first buffer circuit 23a and a second buffer circuit 23b. 
By this operation, Input signals, shown in part (4) of Fig- 
ure 6, to be input to R- and L-MPEG decoders are 
ot)talned. The signals are respectively processed by 
MPEG decoders 16a and 16b in Figure 5. Thus, R and 
L output signals which are synchronized with each other 
as shown in parts (6) and (7) of Rgure 6 are sent to a 
picture output section 31. An audio signal is extended 
by an audio output section 32 and then output. 
[0035] Since the two (R and L) signals are output 
simultaneously in this manner, a flickerless picture is 
obtained t}y sending a 60 fiE>s (frames/sec.) signal from 
each of the R output section 29 and the L output section 
30 to the 3D TV having two (R and L) outputs. In the 
embodiment where an RL mixture signal having 60 
fields/sec. is sent from the RL mixture circuit 28. a 3D 
picture can be viewed with an ordinary TV and 3D spec- 
tacles, although the picture flickere. In the embodiment 
where an RL mixture signal having 120 fields/sec. is 
output, a flickerless 3D picture can be viewed with a 2X 
scan TV and 3D spectacles. In the case where a 3D pte- 
ture is not being output as a 3D picture, a signal Is 
added by a "3D" display signal output section 33 so that 
the TV screen display a symbol indicating "3D'. Then, 
the user is notified that he/she is viewing 3D software in 
a 2D mode and is urged to switch to the 3D output 
mode. In the embodiment where a 3D control signal 
generated by a 3D spectacle control signal generation 



section 33a for switching right and left shutters of the 3D 
spectacles is detected from a frame synchronization 
signal for a decoding signal or from the RL mixture cir- 
cuit 28 and output to an external device, a synchroniza- 
tion signal for the 3D spectacles is obtained. 
[0036] When a line memory 28c of an n-screen syn- 
thesis section 28b in Figure 90 is used, n pieces of pic- 
tures (e.g., two pictures) are output on a TV screen as 
one NTSC signal picture in which the two pictures are 
synthesized. Therefore, two angles can be viewed with 
an ordinary TV A conventional 1 X reproduction appara- 
tus inconveniently displays only one angle at one time 
out of multiple angles. The present invention allows two 
streams to be reproduced sinnihaneously with a 2X 
reproduction apparatus and the MADM reproduction 
system, and also allows two screens to be displayed 
simultaneously. Accordingly, it is not necessary to 
switch the multiple angles. 

[0037] As shown in Figure 90 in detail, when the line 
memory 28c of the n-screen synthesis section 28b is 
used, a two-picture display 28f of two pictures A and B 
having the same size is obtained. Since a line memory 
has a simple structure and is integrated into an IC, the 
n-screen pk^ture display is obtained with a simple struc- 
ture. When a frame memory 28d is used, a two-picture 
display 28g of two pictures having different sizes is 
obtained by a zoom signal from a zoom signal genera- 
tk)n section 28e. Since the user can arbitrarily set the 
size by remote control, the TV picture can be advanta- 
geously viewed at an optimum size. 
[0038] In the triock diagram in Figure 5, two MPEG 
decoders are used. The structure is simplified by the cir- 
cuit configuration shown in Figure 7. The first MPEG 
signal and the second MPEG signal are synthesized 
into one MPEG signal by a symhesis section 36. and a 
2X clock is generated by a 2X clock generation section 

37. A 2X calculation is performed by a 2X clock-type 
MPEG decoder 16c. and the data is extended and out- 
put as R and L vkleo signals through a division section 

38. Such a circuit configuration advantageously limits 
an increase in the cost since it is only necessary to add 
a 16 MB SD-RAM to a memory 39 of an existing 2D 
reproductk)n apparatus. 

[0039] With reference to Rgure 7. synchronous repro- 
duction of two streams which is important in decoding 
3D picture data and progressive picture data will be 
described. First, it is necessary to adjust vertical and 
horizontal synchronization of two stireams within a sin- 
gle line. In order to do tfiis, a first MPEG decoder 16a 
and a second MPEG decoder 1 6b are started substan- 
tially simultaneously by a vertical/horizontal synchroni- 
zation control section 85c to synchronize tiie decoders 
1 6a and 1 6b. TTien, it is necessary that tiie outputs from 
the two decoders should be pictures having an identical 
VPTS. This will be described with reference to tiie flow- 
chart in Figure 57 and Figure 7. in step 241a, tiie syn- 
chronization of a first decoder and a second decoder Is 
cancelled. In step 241 bi tiie decoders are synchronized 
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with each other vertically arxl horizontally. In step 241c, 
an APIS of an audio signal is read, and the ARTS value 
is set as an initial value of an STC of the first decoder 
and an STC of the second decoder. In step 241 e. 
processing of the first decoder is started. In step 241f, it s 
is checked whether or not a first VPTS has reached the 
initial value. If yes, decoding is started in step 241 g. In 
step 241 h, a processing delay time period of the first 
decoder is calculated, and the VPTS of the decoder out- 
put is adjusted so that the APTS and the VPTS are syn- 
chronized with each other. Since the second decoder is 
processed in the same manner, the picture from the first 
decoder and the picture from the second decoder are 
synchronized with each other. Thus, the decoder out- 
puts, i.e.. the first MPEG signal and the second MPEG 
signal are synchronized within one line. Then, the syn- 
chronization on a dot-by-dot basis is obtained by a 
video signal synchronization section 36a of the synthe- 
sis section 36. An original progressive picture is 
obtained e^en by a sum calculation. As shown in Figure 
5. in the case where an APTS 84 is read by the audio 
decoder 16c and an identical APTS is set in registers 
39a and 39b of the STCs of the two MPEG decoders 
1 6a and 1 6b. an audio stream and the two video stream 
are automatically synchronized with one another. 
[0040] In the present invention, when the buffer cir- 
cuits 23a and 23b underflow, either one of the pictures 
is disconnected, as a result of which a disturbed pro- 
gressive picture is output. In order to avoid this, the buff- 
ering amounts of the two buffer circuits are controlled by 
a buffer amount control section 23c as shown in Figure 
5. This operation is illustrated In the flowchart shown in 
Rgure 56. Rrst. in step 240a, a maximum interleave 
value among the NAVI information of each disk Is read, 
and a maximum value of 1 ILB in one main interleave 
block is set. The maximum value is usually 512 sectors, 
i.e..about 1 MB. When the maximum value is set bekyw 
1 MB by a specific format that value is set as the maxi- 
mum value. Next, when an instruction to simultaneously 
reproduce the main and sub interleave blocks is issued 
in step 240b, if the buffering amount of the first buffer 
circuit 23a is 1 ILB or less in step 240c, reproduction is 
performed from the main interleave block, and an 
instruction to transfer the data to the first buffer circuit 
23a is issued. Then, the processing goes back to steps 
240b and 240c. The transfer is stopped in step 240d 
when the buffering amount of the first buffer circuit 
exceeds 1 1LB. Since the data in the buffer circuit 23a 
becomes 1 1LB or more in this manner, underflow is pre- 
vented. 

[0041 ] In step 240f , a maximum value of a sub inter- 
leave block of 1 ILB-Sub is set in the buffer circuit 23b. 
Simultaneous reproduction is perfbrmed in step 240g. 
When the data in the second buffer circuit 23b is 1/2 
ILB-Sub or less, data is read into the buffer circuit in 
step 2401. When the data is more than 1/2 ILB-Sub in 
step 2401. the reading is stopped in step 2401. 
[0042] fis shown in part (4) of Rgure 45. the data 



amount of 1/2 ILB is sufficient in the second buffer cir- 
cuit. /Accordingly, the buffering amount can be reduced 
to half. The buffer control in Figure 56 eliminates the 
underflow of the buffer circuits, thus reducing distur- 
t>ance in the synthesized picture during reproduction. 
[0043] Next, a process for reproducing only an R sig- 
nal by IX rotation of the optical disk will be described. 
The standard rotation speed of a DVD reproduction 
apparatus is referred to as "1 X", and the speed twice the 
standard rotation speed is referred to as "2X". Since it is 
not necessary to rotate the motor at 2X, a 1 X instruction 
is sent from a control section 21 to a rotation speed 
alternation circuit 35 to reduce the rotatk)n speed. A 
process for reproducing only an R signal at IX rotatk)n 
from an optical disk storing the R signal and an L signal 
will be described with reference to the timing diagram in 
Figure 8. As described with reference to parts (1) and 

(2) of Figure 6. the opttoal disk according to the present 
invention has the R-frame group 6 and the L-frame 
group 8 alternately recorded. This is shown in parts (1) 
and (2) of Figure 8. 

[0044] A comparison between the signal shown in 
parts (1) and (2) of Figure 8 and a signal shown in part 

(3) of Figure 8 corresponding to one rotation of the disk 
indicates that the optical disk rotates 5 to 20 times while 
one frame group is reproduced. A track jump of the opti- 
cal head from the R-frame group 6 to the next R-frame 
groip 6a requires several tens of milliseconds. Where 
the wait time period is one rotatbn, which is the maxi- 
mum, the data in the R-frame group 6a can be repro- 
duced within two rotations. This is shown in parts (4) 
and (5) of Figure 8, which are timing diagrams of the 
reproductton signal and the signal corresponding to one 
rotation of the disk. The time axis of the reproductton 
signal in part (4) of Figure 8 is adjusted by the buffer cir- 
cuit 23a in Figure 5, and an MPEG signal having contin- 
uous R frames as shown in part (6) of Figure 8 is output 
from the buffer circuit 23a. This signal is extended to be 
an R video signal as shown in part (7) of Figure 8 by the 
MPEG decoder 16a. By selecting a different channel in 
the same manner as the case of the R signal, a 20 sig- 
nal of the L channel is obtained. According to the 
present invention, the R or L channel is assigned to a 
frame group of 1 GOP or more and the frame group is 
recorded continuously over a plurality of tracks. Thus, 
even when a 3D optical disk is reproduced by a 1X 
reproduction apparatus, a 2D output of only the R chan- 
nel is obtained. 

[0045] As can be appreciated from this, as shown in 
the block diagram of Figure 9, a reproduction apparatus 
specifically for 2D display is obtained by altering the 
structure of the 3D reproductk)n apparatus in Rgure 5 
80 that there is only one buffer circuit 23 in lieu of two, 
one MPEG decoder 16 in lieu of two, and one picture 
output section 1 7. Such a 2D reproduction apparatus 40 
includes the 3D picture arrangement information repro- 
duction section 26. and therefore, reproduces a 3D pic- 
ture identifier and arrangement information of the 3D 
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Optical disk 1. Accordingly, when the data in the optical 
disk 1 Is reproduced by the 20 reproduction apparatus, 
data in either one out of the R and L channels is output. 
Since the R and L channels oorrespood to an Identical 
picture, it is a waste of time to output the pictures in the 5 
R and L channels by switching the channels by a chan- 
nel selection section 20. According to the present inven- 
tion, a 3D channel output control section 41 restricts 
data to be output from only either channel, for example, 
the R channel, using the 3D picture identifier. Thus, data 
in only the R or L channel of Identical video contents is 
output, avoiding the situation in which the user selects 
an unnecessary channel. 

[0046] When a 3D picture is provided, the "3D" display 
signal output section 23 displays the symbol "3D" on the 
screen or a display section 42 of the reproduction appa- 
ratus. Therefore, the user can recognize that the picture 
is a 3D pictura The optical disk according to the present 
invention provides both 2D and 3D pictures when repro- 
duced by the 3D reproduction apparatus 43 in Figure 5 
and a 2D picture when reproduced by the 2D reproduc- 
tion apparatus in Figure 9. In this manner, the compati- 
bility between the 2D reproduction apparatuses and 3D 
reproduction apparatuses realized. 
[0047] Now. returning to the 3D reproduction appara- 
tus, use and effect of a 3D picture identifier will be 
described. 

[0048] Figure 1 3 is a timing diagram of a 3D picture 
identifier and an output signal. One Interleave bk)ck is 
defined as a time unit "t". In parts (3) through (6) of Fig- 
ure 13, a delay time period of It Is generated although 
not shown. As shown In part (1) of Figure 13, the state 
of the 3D picture identifier Is changed from "1" to "0" at 
Ut7. As shown In part (2) of Rgure 13. the R-frame 
groups 6. 6a and 6b and the L-frame groips 8. 8a and 
8b of a 3D picture are recorded from t1 through t7. From 
t? through t1 1 . pictures A and B of different contents are 
recorded. In more detail, first-frame groups 44 and 44a 
of picture A and second-frame groups 45 and 45a of 
picture B are recorded. Since the DVD format does not 
define 3D pictures, a 3D picture identifier is not Included 
in the data or directory information of the disk Accord- 
ingly, a 3D picture arrangement information file needs to 
be read wtien the optical disk is started. As shown in 
parts (3) and (4) of Figure 13, from t1 through t7, data In 
first time domains 46, 46a and 46b can be output to the 
R channel, and data in the second time domains 47, 
47a and 47b can be output to the L channel. After t=t7, 
no 3D picture identifier is available. Accordingly, data in, 
for example, first time don^ins 46c and 46d is output to 
both the R and L channels. As shown In parts (5) and 
(6) of Rgure 13, a different output system is adopted for 
a mixture output. From tl through t7 when the 3D pic- 
ture identifier is "1", even field signals 48 and 48a and 
odd field signals 49 and 49a are aKernately output from 
one output at a field frequency of 60 Hz orl 20 Hz. In 
more detail, data in the first time domains 46 and 46a is 
output as the even field signals, and data in the second 



time domains 47 and 47a is output as the odd field sig- 
nals. 

[0049] After t»t7 when the 3D picture identifier Is not 
available, data in tiie first time domains 46c and 46d is 
output as both the even field signals 48d and 48e and 
the odd field signals 49d and 49e. 
[0050] As described above, the manner of outputting 
signals to tiie 3D display is changed in accordance with 
whether or not the 3D picture arrangement information 
indicates the absence of the 3D picture. In this manner, 
it is prevented that pictures of different contents from 
each other are presented for the right and left eyes of 
the user. Without such a function, the folk)wing incon- 
venience occurs In the case where the first time 
domain and the second time domain of the optical disk 
start to include different contents from each other while 
the user Is viewing a rfght-eye picture and a left-eye pic- 
ture of ttie same contents, a pk:ture of content A is pre- 
sented to the right eye and a picture of content B is 
presented to the left eye. Such an abnormality makes 
tiie user feel uncomfortable. 

[0051] With reference to the flowchart of Figure 17. 
ttie above-described process will be described in detail. 
In step 50a, an optical disk is nrx>unted. In step 50b. a 
file of a list of contents in the optical disk is read. The file 
does not Include a 3D picture Identifier. In step 50c, a 
3D picture an^angement information is read from a 
TXTDT file of ttie disk 

[0052] In step 50d, ttie list of contents is displayed 
based on the 3D picture an-angement Information. At 
ttiis point, "SD" is displayed for each of tiie contents on 
ttie menu saeen, so ttiat ttie user can recognize ttiat 3D 
contents are available. This information can be in one 
area of ttie optical disk or included in navigation infor- 
mation provided on a data-by-data tiasis. 
[0053] I n step 50e. data in a specific address is repro- 
duced. In step 50f, it is determined whether or not the 
data is 3D data with reference to ttie 3D picture arrange- 
ment information. If yes, in step 50g, signals are 
decoded. For example, an R signal in ttie first time 
domain 46 and an L signal in ttie second time domain 
47 are decoded. The data in ttie first time domain 46 is 
output as the right-eye picture, and the data in the sec- 
ond time domain 47 is output as ttie left-eye picture. The 
pictures are synchronized. For reproduction of the next 
data, the processing goes t^ack to steps 50e and 50f. 
where it is determined whether or not the picture Is a 3D 
picture. If no. ttie processing goes to step 50h, where 
ttie data in either one of ttie first time domain 46 or ttie 
second time domain 47 is output as both the right-eye 
picture and the left-eye picture. In other words, tiie 
same picture is output for the right eye and the left eye. 
Thus, pictures of different contents are prevented from 
being output to the right eye and the left eye. 
[0054] According to ttie present Invention, an ordinary 
picture and a 3D picture botti of ttie Interleave block sys- 
tem are reproduced in different manners. This will be 
described, hereinafter. 
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[0055] With reference to Figure 14, part (1) shows 
data recorded on the optical disk. A first interleave block 
56 includes data A1 and a leading address aS of the first 
interleave block 56 to be accessed next i.e., the next 
pointer 60. Accordingly, as shown in part (2) in Figure 
14. when reproduction of the first interleave block 56 is 
terminated, only the address of the pointer 60a needs to 
be accessed. Thus, the optical head performs a track 
jump to access the next first interleave bkx^k 56a within 
1 00 ms and reproduces data A2. Data A3 is reproduced 
in same manner. In this manner, contents A1 through 
A3 are reproduced. 

[0056] Part (3) of Figure 14 is related to an optical disk 
having 3D pictures for R and L outputs. The optical disk 
includes the same pointer 60 in order to have the same 
format as in part (1) of Figure 14 for compatibility. 
Accordingly, a 3D picture is not reproduced unless the 
pointer 60 is Ignored. 

[0057] A 3D picture identifier 61 of each cell is defined 
based on the 3D picture logical arrangement table. 
Accordingly, 3D picture identifiers 61 of interleave 
blocks 54, 55, 56 and 57 are logically defined. This is 
shown in part (3) of Figure 14. The pointer cannot be 
used as it is in order to reproduce data R1 and L1 and 
then reproduce data R2 and LI after a track jump. Spe- 
cifically, when reproduction of the R interleave block 54 
is oornpleted, the address of the pointer aS is not 
accessed. Rather, after reproduction of the next L inter- 
leave bk)ck 55, the optical head performs a track jump to 
the pointer a5 of the R interleave block. In this case, the 
pointer 60b of the L interleave block 55 is ignored. For 
reproducing an interleave block where the 3D picture 
identifier Is available, it is advantageous to change the 
manner of accessing the pointer address from the case 
of the reproduction of an ordinary picture, the advan- 
tage being that R and L pictures are continuously repro- 
duced as shown in part (4) of Figure 14. 
[005Q With reference to flowcharts in Figures 1 5 and 
16. a process of changing the manner of accessing the 
pointer address when reproducing an interleave block 
using a 3D picture anangement information will be 
described. 

[0059] In step 62a. an access instructran to an 
address of a specific cell is issued. In step 62b, it is 
determined whether or not the picture to be accessed is 
3D with reference to the 3D picture arrangement infor- 
matton. If the picture is determined ncft to be 3D in step 
62c, the processing goes to step 62t. where the picture 
is processed as an ordinary picture. If the picture is 
determined to be 3D in step 62c. the processing goes to 
step 62d. where it is checked whether or not the user 
intends to reproduce the picture as a 3D pictura If na 
the "3D" mark is displayed on the screen and the 
processing goes to step 62t. 
[0060] If yes in step 62d. the 3D picture arrangement 
information is read in step 62e. and the locations of the 
R and L interleave blocks are calculated based on. for 
example, the chapter number, R cell number and Lcell 



number. In step 62g. the nth R interleave block is repro- 
duced. In step 62h, the pointers recorded in the R inter- 
leave block and the L interleave Nock are read and 
stored in the pointer memory. In step 621, the previous 
5 pointer (i.e., the (n-1 )th pointer AL (n)) is read from the 
pointer memory. In step 62j. it is checked whether or not 
pointers AL(n) and AR(n) are continuous with each 
other. If no, a jump to the address AL(n) is performed in 
step 62k. 

10 [0061] As shown in Figure 16. in step 62m, the nih L 
interleave block is reproduced. In step 62n, the first 
VPTS and the second VPTS are output in synchroniza- 
tion using the pointer AR(n+1). In step 63g. the first 
VPTS and the second VPTS are synchronized using 

15 APTS of the main interleave block. If in step 63h. the 
signal is found to be a PG. i.e.. progressive signal, in 
step 631. a sum and a difference of the two decoding 
output signals are found to and a vertical synthesis is 
perfomied. TTius, a picture having an improved vertical 

20 resolution such as a 525P picture is obtained. 

[0062] If the signal is found to be wide 525P(i) in step 
63j. a sum and a difference of the two decoding output 
signals are found and a horizontal synthesis is per- 
formed. Thus, a picture having an improved horizontal 

25 resolution such as a wide 525P(i) picture of. for exam- 
ple, 1440x480 pixels is obtained. In step 62p, it is 
checked whether or not the reproduction of all the 
streams is completed. In step 62q, it is checked whether 
or not the nth L interleave block and the (n+1)th R inter- 

30 leave block are recorded continuously with each other. If 
no, a track junp to the AR(n4-1) is performed in step 62r 
and the processing goes back to step 62f. If yes in step 
62q. the processing directly goes back to step 621. 
[0063] In the case where the "3D" mark mentioned 

35 regarding step 62t is not displayed on the screen, the 
starting address A(1) of cell h is accessed and the first 
interleave block is reproduced. Then, in step 62u, the 
nth interleave bfocks of address A(n) are sequentially 
reproduced. In step 62v, the pointer address A(n+1) for 

40 accessing the next interleave block by jumping is read. 
In step 62w, it is checked whether or not the reproduc- 
tion of all the data is completed, if yes, tiie processing 
goes back to step 62a. If no, in step 62x. it is checked 
whether or not A(n) and A(n+1) are continuous with 

45 each other. If yes, the processing goes back to the step 
before step 62u witiiout jumping. If no. In step 62y. a 
jump to the address A(n+1) is performed. 
[0064] Figure 20 is a block diagram of a reproductfon 
apparatus 65 according to the present invention. An 

50 Operation of the reproduction apparatus 65 for repro- 
ducing 2X progressive pictures, wide screen pictures 
and 720P pictures will be described. A signal repro- 
duced from an optical disk 1 is divkf ed by a division sec- 
tion 8 into a first interleave block 66 and a second 

55 interleave block 67 each including frames con-espond- 
ing to 1 GOP or more. The blocks are respectively 
MPEG-extended into frame video signals 70a and 70b 
each having 30 frames^. The video signal 70a is 
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divided by a field division section 71a into an odd field 
signals 72a and 73a. The video signal 70b is divided by 
a field division section 71 b into an odd field signals 72b 
and 73b. Thus, 2-ch NTSC interlace signals 74a and 
74b are output. The wide screen picture reproduced by 
the reproduction apparatus in Rgure 20 will be 
desaibed later. 

(0065] With reference to Figure 22. an encoding oper- 
ation of a progressive video signal will be described. 
Progressive video signals 75a and 75b are input at time 
t1 and t2, and divided by a division section 38 into an 
Odd First interlace signal 244 and an Even First inter- 
lace signal 245. Where the n'th tine (e.g., 1st line) of the 
interlace signal 244 is labeled as "An" and the nth line 
(e.g., 2nd line) of the interlace signal 245 is labeled as 
"Bn". a vertical filter 142 performs a sum calculation, 
i.e., 1/2(An+Bn). thus obtaining a low frequency compo- 
nent. In other words, a function of an interlace interfer- 
ence removal filter 141 is performed. In the case where 
the resultant component is reproduced from only one 
angle by a conventional reproduction apparatus, an 
NTSC signal with no interlace interference is obtained. 
"An" of the interlace signal 244 is also divided by a color 
division section 242 and input Id a color synthesis sec- 
tion 243 without passing through the vertical filter 142. 
In the color synthesis section 243, the signal from the 
color division section 242 and the signal from the verti- 
cal fUter 142 are synthesized (1/2(AfB}). Then, the 
resultant signal is compressed by an MPEG encoder. 
[0066] A vertical filter 1 43 performs a difference calcu- 
lation, i.e.. 1/2(An-Bn). thus obtaining a high frequency 
component, i.e., difference information. This signal is 
compressed by an MPEQ encoder without being com- 
bined with the color signal. Accordingly, the amount of 
the difference information is advantageously reduced by 
the amount of the color signal. 
[0067] Rgure 23 is a view representing the concept of 
the structure of Figure 22. This system is referred to as 
multiple angle video data division multiplex system 
(MADM) since a video signal is divided into vertical or 
horizontal high frequency and low frequency compo- 
nents and recorded in the state of being cfivided into pic- 
tures of multiple angles. As shown in Figure 23, a signal 
is divided into a t)asic signal (sum signal) and a sub sig- 
nal (difference signal) by a sum calculation section 141 
and a difference calculation section 143. The resultant 
signals are MPEG-encoded and then recorded as an 
interleave block in units of 1 GOP. At this point, the 
amount of the information can be reduced by 20% by 
performing 3-2 transform of the t>asic signal and the sub 
signal in synchronization with each other. It is efficient to 
use, as the basic signal. "IBBPBBPBBPBBPBB" which 
is shown as a main GOP structure 244 used for the ordi- 
nary MPEG encoding. In this structure, an I frame 246, 
B frames 248 and P frames 247 are alternately 
arranged. In the case of the difference signal, experi- 
ments have shewn that it is efficient to have a structure 
including onty I frames 246n and P frames 247 due to 



the profile pattern, for example, "IPPPPPPPIPPPPPPP" 
shown In a sub GOP structure 245. The efficiency is 
improved by changing the setting for the sub GOP struc- 
ture. 

s [0068] Figure 23 shows an example in which a S25P 
video signal is divided into two in a vertical direction. 
Figure 58 (described below) shows an example in which 
a 525P video signal is divided into two in a horizontal 
direction. In an alternative manner, a 60-frame 525P 

10 signal is divided by frame division means into 30 odd 
frames and 30 even frames. In this case, the respective 
SOP signals are transformed into two 60-field interlace 
signals, and each of the signals are MPEG-encoded to 
be recorded in the MADM system. Such encoding is 

IS performed in a progressive manner, and therefore 
erxxxiing efficiency is improved as in the case of the 
movie. Thus, the recordable time period of the same 
disk is extended. 

[0069] When such a signal is reproduced by a non- 
20 MADM reproduction apparatus, a SOP (one-channel) 
525 interlace signal is reproduced. Such a signal lacks 
necessary frames and is distorted. 
[0070] When such a signal is reproduced by an 
MADM reproduction apparatus, a SOP signal as a basic 
2S signal and a SOP signal as a sub signal are reproduced. 
These two SO-frame signals are synthesized into a 60- 
frame normal 525P signal by frame synthesis means 
including a frame buffer, and then output. 
[0071 ] When a line doubler is added to an output sec- 
30 tion for the 525P signal, a 1050P video signal is 
obtained. 

[0072] When a 525 interlace signal is input to a sum 
signal section of the synthesis section of the MADM 
reproduction apparatus and the value of 0 is input to a 

3s difference signal section of the synthesis section, a 
525P picture is obtained. Such a manner of input has 
the same effect as the line doubler. This method allows 
even an 525 interlace signal to be output as a 525P sig- 
nal. Accordingly, all types of pictures can be viewed by 

40 simply connecting one cable to a progressive input ter- 
minal of the MADM reproduction apparatus. 
[0073] In Rgure 23. 1/2(A+B) and 1/2(A-B) are used 
as expressions for calculation for a two-tap filter. The 
separation frequency con-esponds to about 300 scan- 

45 ning lines. 

[0074] When a four-tap filter as shown in part (c) of 
Rgure 46 is used, the number of scanning lines con-e- 
sponding to the separation frequency can be reduced to 
about 200. An example of using such a frequency will 

50 be described. When the anrK)unt of information repre- 
sented by the basic signal is too large to encode the 
information, it is advantageous to reduce the number of 
scanning lines conresponding to the separatfon fre- 
quency to less than 300, for example, 220. In this case. 

5s the amount of information represented by the basic sig- 
nal is signif icaiTtly reduced and thus the information can 
be encoded. Although the amount of informatfon repre- 
sented by the sub signal, i.e., difference signal is 
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increased, it is not serious because the difference signal 
does not include color information and thus originally 
contains only a small amount of information. Therefore, 
there is no problem of insufficiency in the encoding 
capability of the encoder. An original picture is repro- 
duced normally by the following setting. The filter infor- 
mation can be contained in a filter identifier 144 in 
Figure 50. The filter characteristics are changed in units 
of 1 cell or 1 GOP by altering the constant of the sum 
calculation section and the difference calculation sec- 
tion by filter separation frequency alteration means of 
the reproduction apparatus with reference to identifiers 
100, 101 and 111. By such setting, a high rate picture, 
. which is usually difficult to encode, can be encoded. 
[0075] Returning to Figure 22, the MPEG encoder 
section synthesizes an odd interlace signal 79a and an 
even interlace signal 80a and also synthesizes an odd 
interlace signal 79b and an even interlace signal 80b, 
thus obtaining frame signals 81a and 81b. The frame 
signals 81a and 81b are compressed by MPEG com- 
pression sections 82a and 82b to generate compres- 
sion signals 83a and 83b. Interleave blocks 84a, 84b 
and 84c each including 1 0 to 1 5 frames of the compres- 
sion signals 83a and 83b corresponding to 1 GOP or 
more are generated. Compression signals obtained 
from an identical progressive signal are provided with 
an identical time stamp by time stamp provision means, 
and then the signals are recorded on an optical disk 85. 
[0076] The progressive signal recorded on tiie optical 
disk 85 is reproduced by a 2X reproduction apparatus 
shown in Figure 21 . The reproduced signal is divided by 
a dfvisk)n section 87 into a stream of interleave blocks 
84a and 84c and anotiier stream of an interteave tHock 
84b. Then, tiie streams are extended by extension sec- 
tions 88a and 88b into frame signals 89a and 89b each 
having 720x480 pixels. The progressive signal is 
divided by fieM division sections 71a and 71b Into odd 
fields 72a and 72b, and even fields 73a and 73b on a 
time axis, as by the reproduction apparatus shown in 
Figure 20. 

[0077] In Figure 21 , unlike the apparatus in Rgure 20, 
the odd fields 72a and 72b of channel A 91 and channel 
B 92 are synthesized by a synthesis section 90 using a 
sum calculation circuit and a difference calculation cir- 
cuit. The even fields 73a and 73b are synthesized in the 
same manner. Thus, channel A 91 and channel B 92 
are synttiesized in a zigzag manner. As a result pro- 
gressive signals 93a and 93b are obtained and output 
from a progressive video output section 94. 
[0078] In this manner, a progressive video signal, i.e., 
non-interlace NTSC signals of 525 scanning lines is 
obtained by the reproduction apparatus according to the 
present invention. In this example, a progressive signal 
of 480 scanning lines is obtained. The reproduction sec- 
tion 95 performs 2X reproduction. 
[0079] Advantageously, a movie or the like recorded in 
a conventional optical disk are also reproduced as a 
progressive picture. 



[0080] Rgure 23 shows an example in wNch the sig- 
nal is divkJed in a vertical direction by the MADM sys- 
tem. With reference to Figure 58. an example in which 
tiie signal is divided in a horizontal direction by tiie 

5 MADM system will be described. A wkle 525P picture 
of. for example. 1440x480P has been studied for mov- 
ies. Such a signal is transformed into an interlace signal 
of 1440x4801 by a 3-2 transform section 174. The signal 
is divided by a horizontal filter section 206a into two in a 

10 horizontal direction. Figure 59 illustrates the principle of 
the filter in parts (a) and (b). As shown in part (b), 1440 
dots are divided into odd dots 263a and 263b. and even 
dots 264a and 264b. Where tiie odd dots are labeled as 
"Xn" and the even dots are labeled as "Yn", a sum sig- 

15 nal is obtained by X+Y and a difference signal is 
obtained by X-Y. As a result, two 525P or 5251 signals, 
each of 720x480. are obtained as shown in part (b) of 
Figure 59. 

[0081 ] Returning to Figure 58. tiie number of horizon- 

20 tal dots of such a horizontal sum signal is reduced to 
720. Since tiie signal is passed through tiie horizontal 
filter, however, aliasing distortion is as low as that of an 
NTSC Signal. A conventional reproduction apparatus 
reproduces only the sum signal and accordingly pro- 

25 vides a DVD picture of the same quality. The difference 
signal represents only a profile formed of tine-drawing. 
However, since the difference signal is restricted by a 
second vkleo signal output restriction provision section 
179 so as not to be reproduced by an ordinary repro- 

30 duction apparatus, no problem occurs. The sum signal 
and the difference signal are respectively encoded into 
MPEG streams by a first encoder 3a and a second 
encoder 3b, and sul)iected to interleaving in units of an 
interleave block of 1 GOP or more and MADM-multi- 

35 plexed. 

[0082] As shown in Figure 50. in tiie case of a nrK)vie. 
a signal is transformed by a 3-2 transform section 174 
and MADM-recorded as an MPEG signal togetiier witti 
3-2 transform information 174a. 

40 [0083] In the case of tiie movie, 24 frames are repro- 
duced in one second. Accordingly, a 1440x480P pro- 
gressive pictijre is reproduced based on two interlace 
signals by a 2X reproduction apparatus. The scope size 
of tiie nravie is 2.35: 1 . The format of 1 440x480P is suit- 

45 able for the scope size of 2.35:1 in terms of the aspect 
ratio. Thus, a wide screen 525P is effectively repro- 
duced. 

[0084] When a movie on the optical disk for a 1 X inter- 
lace reproduction apparatus is reproduced by the repro- 

50 duction apparatus shown in Figure 20, a 24-frames/feec. 
progressive signal is obtained in an MPEG recorder 
since a movie signal is a progressive signal having 24 
frames/sec. The progressive signal is reproduced by 
detecting tiiat the optical disk includes a movie by 

55 detection means or by transforming the 24-frame/isec. 
signal into a 60-frame/sec. progressive signal by the 3- 
2 transform section 174. An interlace picture with no 
interference is obtained by filtering tiie progressive sig- 
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nal by a vertical filter with reference to the filter identifier. 
[0085] An optical disk 85 encoded with reference to 
Figure 22 is reproduced by the reproduction apparatus 
65 conforming to the progressive system. Then, a chan- 
nel-A interlace signal 74a is reproduced. A conventional s 
interlace DVD player has only channel A but not channel 
B. Therefore, when the optical disk 85 according to the 
present invention is nfiounted on the conventional inter- 
lace DVD player, the channel-A interlace signal is 
obtained. As can be appreciated, an optical disk accord- 
ing to the present invention provides a progressive sig- 
nal when reproduced by a reproduction apparatus 
according to the present invention, and provides an 
interlace signal of the same contents when reproduced 
by a conventional reproduction apparatus. Thus, the 
optical disk according to the present invention realizes 
complete compatibility even with the conventional repro- 
duction apparatus. 

[0086] In the MPEG encoder shown in Figure 22, an 
interlace interference removal compression filter 141 is 
provided to significantly reduce the aliasing distortion. 
[0087] Hereinafter, encoding of a 3D picture will be 
described in detail. 

[0088] A right-eye signal 97 and a left-eye signal 98 
are input into a recording apparatus 99 In the same 
manner as the sum signal and the difference signal of 
the progressive signal described with reference to Fig- 
ure 22. Since this is an interlace signal, odd field signals 
72a and 72b and even field signals 73a and 73b are 
input every 1/60 second. The signals 72a and 73a and 
the signals 72b and 73b are synthesized by synthesis 
sections 101a and 101b into 1/30 sec. frame signals 
83a and 83b. These signals are compressed by com- 
pression sections 103a and 103b into compression sig- 
nals 83a and 83b. Interleave blocks 84a. 84b and 84c. 
each including frames of these signals corresponding to 
1 GOP or more, are generated. The interleave blocks 
84a. 84b and 84c are alternately located and recorded 
on the optical disk 1 . When data in the resultant optical 
disk is nrK}unted on the reproduction apparatus shown in 
Figure 24 for reproduction, the 3D/PG picture arrange- 
ment infomiation reproduction section 26 described 
above with reference to Figure 5 detects a PG identifier 
in the disk. Therefore, the reproduction apparatus (104) 
is put into a 3D reproduction mode as shown in Figure 
24. The 3D picture in the optical disk is divided by a divi- 
sion section 68 into channel A and channel B. The data 
in the channels are extended respectively by extension 
sections 88a and 88b and then divkJed into f iekd signals 
by field division sections 71a arKl 71b. The operation of 
the reproduction apparatus up to this point is the same 
as in the case of Figure 21 . 

[0089] A feature of the reproduction apparatus shown 
in Figure 24 is that the field division section 71a outputs 
odd field signals and even field signals while switching 
the output order thereof by an output transform section. 
When the signals are sent to a progressive TV, i.a , a TV 
having a fieM frequency of 120 Hz. the signals are out- 



put from a progressive output section 105 in the order of 
a channel-A odd fieW signal 72a, channel-B odd fiekJ 
signal 72b, channel-A even field signal 73a. and chan- 
nel-B even field signal 73b. Thus, the right-eye signals 
and the left-eye signals are output alternately and in the 
order of the odd fiekJ and then the even field. Accord- 
ingly, a flickerless picture having matching right-eye and 
left-eye information is obtained through switch-type 3D 
spectacles. 

[0090] When the signals are sent to an ordinary TV, 
the channel-A odd field signal 72a and the channel-B 
even field signal 73b are output from an NTSC output 
section 106. Then, a 3D picture displaying natural 
motions is obtained through 3D spectacles although the 
picture includes flicker. 

[0091 ] By combining the progressive system and the 
3D picture reproduction system according to the 
present invention, a high definition 3D picture including 
a right-eye picture and a left-eye picture is realized. This 
will be described with reference to Figure 25. A repro- 
duction apparatus 107 performs 4X reproduction. When 
reproducing a DVD, 80% of such a transfer rate is suffi- 
cient In the embodiment where interleave blocks 108a. 
108b. 108c and 108d of right progressive signals A and 
B and left progressive signals C and D are arranged 
with no interval as shown in Figure 25. the optical 
pickup does not need to jump for continuous reproduc- 
tion. In the case of DVD, only 80% of the information is 
reproduced. The reproduction rate can be 3.2X in lieu of 
4X in the case of continuous reproduction. Such a con- 
tinuous an-angement advantageously reduces the 
reproduction rate. 

[0092] The signal is divkied into interleave blocks 
108a. 108b, 108c and 108d. and signals for channels A, 
B, C and D are reproduced. The video signals extended 
by extension sections 69a. 69b. 69c and 69d are syn- 
thesized by synthesis sections 90a and 90b as in Figure 
21, and two progressive signals are output from pro- 
gressive output sections 110a and 110b. The two pro- 
gressive signals are respectively a right- eye signal and 
a left-eye signal. Accordingly, a progressive 3D picture 
is obtained by the reproduction apparatus 107. When a 
4X MPEG chip is used, only one chip is sufficient and 
avoids an increase in the number of components. The 
4X MPEG chip realizes recording and reproduction of 
pictures of four different contents. In this case, pictures 
are displayed on a 4-part multi-saeen TV simultane- 
ously with one optical disk. 

[0093] A feature of the present invention is to provide 
compatibility among all the apparatuses and media. 
When data on a disk 106 in Figure 25 is reproduced by 
a conventional reproduction apparatus, an interlace sig- 
nal for either the right eye or the left eye is output The 
picture is not deteriorated although the reproductnn 
time is reduced to 1/4. However, a two layer DVD stores 
data for 2 hours and 15 minutes. Almost all movies are 
accommodated in such a DVD. 
[0094] When data on the disk 106 in Figure 25 is 
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reproduced by a 2X SO/j^rogressive reproduction appa- 
ratus according to the present invention, the user 
switches from a 3D interlace picture to a one-channel 
progressive picture or vice versa by serxiing an instruc- 
tion to a control section 21 through a channel selection 
section 20 from an input section 19 (see Figure 9). As 
described above, the present invention has an effect of 
providing complete compatibility analogous to that 
between the monaural records and stereo records dis- 
cussed in the past. 

[0095] According to the 2X and 4X reproduction appa- 
ratuses according to the present invention, pictures of 
various qualities are obtained in various display man- 
ners. 

[0096] As described above, according to the present 
invention , when a 3D identifier is not available, the 
pointer is read and the optical head jumps. When a 3D 
identifier is available, the reproduction process Is 
changed so that the pointer of one of the immediately 
previous interleave blocks is read and accessed. Thus, 
a 3D picture Is recorded without changing the format. 
[0097] A method for performing recording and repro- 
duction while a scope-size movie screen is divided into 
two. 

[0098] In Figure 20, an optical disk 1 having two- 
screen interlace signals is reproduced. Now, with refer- 
ence to Figure 40, this concept is applied to a scope- 
size (2.35:1) super wide screen 154. The super wide 
screen 154 is divided into three, i.e.. a center screen 

156 and side screens 157 and 158 by a screen division 
section 155. The position of division is represented by a 
center shift amount 159. The center picture 156d is 
compressed as a first video signal. The side pictures 

157 and 158 are compressed together as a second 
video signal. The compression signals are processed 
with interleaving and are recorded on an optical disk 
191 together with the center sNfl amount 159. In this 
case, the second video signal, wNch represents a pic- 
ture obtained by sewing together two different quality 
pictures, is not desired to be output. Accordingly, a sec- 
ond video signal restriction information provision sec- 
tion 179 adds reproduction restriction information such 
as. for example, password protection to the second 
video signal stream. Then, the reproduction apparatus 
cannot reproduce the second video signal independ- 
ently In this manner, it is prevented that the user views 
an abnormal picture of only the second video signal. In 
this case, a progressive reproduction apparatus repro- 
duces both the first and second video signals to realize 
a wide screen. 

[0099] When such an optical disk is reproduced by the 
reproduction apparatus in Figure 20. the second video 
signal is not independently output From the optical 
disK the center shift amount 159 is reproduced by a 
center shift amount reproduction section 159b. A wide 
picture synthesis section 173 uses the center shift 
amount 1 59 to synthesize a scope-size picture. The 3-2 
transform section 1 74 performs 3-2 pull-down transform 



shown in Figure 41 to transform a 24-frame/sec. signal 
of the movie into a 60-flelds/sec. Interlace signal or a 
SO-frames/sec. progressive signal. As shown in Figure 
41, both the extension and wide picture synthesis are 

s perfomied. The 3-2 transform performed by the 3-2 
transform section 174 is as folfows. A synthesis picture 
179a having 24 frames/sec. Is transformed Into three 
interlace pictures I80a, I80b and I80c. A synthesis 
picture 179b is transformed into two Interlace pictures 

10 180d and 180e. Thus, the picture having 24 frames/sec. 
is transformed into a 60-fields/sec. interlace picture. A 
progressive picture 181 can be output as three progres- 
sive pictures 181a. 181b and 181c and two progressive 
pictures 181d and 181 e. 

IS [0100] Another method for dividing a screen is as fol- 
lows. As shown in Figure 40. a 1440x480 screen 154 is 
divided into two horizontal separation screens 190a and 
190b each having 720x480 pixels. Such division is per- 
fomied by separating odd number of columns of pixels 

20 from even number columns of pixels by a picture hori- 
zontal division section 207. These screens 190a and 
190b are compressed as a first video signal and a sec- 
ond video signal in a similar manner to the above- 
described manner and recorded on the optical disk 191 . 

25 In order to avoid aliasing distortion, two pixels are 
added by a horizontal filter 206 shown in Figure 46 at a 
specific addition ratio, so that the high frequency com- 
ponent in the horizontal direction is attenuated. Such 
processing avoids generation of moird, which appears 

30 when the optical disk is reproduced by an existing repro- 
duction apparatus at 720 dots. 
[Q1 01 ] When the optical disk 1 91 is reproduced by the 
reproduction apparatus 65 shown in Figure 20, the hor- 
izontal separation screens 190a and 190b are decoded. 

35 When the decoded signals are synthesized by the wide 
picture synthesis section 173. an original 1440x480- 
pixei screen 1 54a is obtained. In the case of movies. 3- 
2 transform is performed by synthesizing the screen 
154a as shown in Rgure 41 . 

40 [0102] The second method of horizontally dividing the 
screen is advantageous In providing a level of high com- 
patibility for the following reason. The first video signal 
and the second video signal both represent an ordinary 
720x480-plxel picture obtained by dividing the original 

45 1440x480-pixel picture into two by a horizontal line. 
Accordingly, even when the second video signal is erro- 
neously reproduced by an ordinary reproduction appa- 
ratus such as a DVD player, the resultant picture has the 
same aspect ratio as that of the original picture. Such a 

50 division system advantageously realizes reproduction 
of an interlace picture by an ordinary reproduction 
apparatus, reproduction of a 525 progressive picture by 
a progressive reproduction apparatus, and reproduction 
of a wide saeen picture having a scope of. for example. 

55 720P by a 720P high resolution reproduction apparatus. 
Such advantages are conspicuous in the case of mov- 
ies, which can be reproduced at the rate of 2X. 
[0103] This method is applied as shown In Figure 44. 
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A 1440x960 progressive picture 182a is divided in hori- 
zontal and vertical directions by a horizontal and vertical 
division section 194 of a picture division section 115 
using, for example, sub-band filter or wavelet transform. 
Then, a 525 progressive picture 183 is obtained. This is 
divided into interlace signals 184 and recorded as a 
stream 188a. 

[0104] Interpolation information 185 is divided into 
four streams 188c, 188d, 188e and 188f in a similar 
manner and recorded in units of an interleave block. 
The maximum transfer rate of each interleave block is 8 
Mbps by the DVD format. When the interpolation infor- 
mation 185 is divided into four streams, the transfer rate 
of 32 Mbps is obtained. In the case of six angles, the 
transfer rate of 48 Mbps is obtained. Thus. 720P and 
1050P HDTV pictures can be recorded. In a conven- 
tional reproduction apparatus, a stream 188a is repro- 
duced and an interlace picture 184 is output. Regarding 
the streams 188c. 188d. 188e and I88f. output restric- 
tion information is recorded on an optical disk 187 by a 
picture processing restriction information generation 
section 179. Therefore, an ugly picture of Interpolation 
informatton 185 such as differential information or the 
like is not output in error. An opttoal disk compatible with 
HDTV and NTSC is realized by dividing a signal in a 
horizontal direction by the system shown in Figure 44. 
[0105] In Figure 20. an Interlace signal is obtained by 
the transform performed by the interlace transfbrm sec- 
tion 175. and as a result, a scope-size screen 178 is 
obtained. A 525P progressive signal is also output on a 
scope-size screen in a similar manner. When viewed by 
a 720P monitor, a 525P signal is transformed into a 
720P progressive signal by a 525P/720P transform sec- 
tion 176. as a result of which a letter box-type 720P 
screen 177 having 1280x720 or 1440x720 pixels (pic- 
ture has 1280x480 or 1440x480 pixels) is output. A 
scope-size picture (2.35:1) has 1 128x480 pixels. A pic- 
ture having a similar aspect ratio to this is obtained. A 
movie signal has 24 frames/sec. Therefore, the transfer 
rate of the progressive picture is 4 Mbps. When the 
scope-size picture is recorded by the 2-8creen system 
accading to the present invention, the transfer rate is 8 
Mbps. Since a two-layer DVD can store data for about 2 
hours and 15 minutes, a 720P or 525P high definition 
progressive picture can be recorded on one optical disk. 
Such data is output on a conventional TV as an inter- 
lace signal, needless to say As described above, the 
scope-size (2.33:1) picture of the movie can be output 
as a 525P or 720P picture. 

[0106] Hereinafter, a specific method for recording 
and reproducing a 1050 interlace signal will be 
desaibed. An even field 208a of a 1050 interlace signal 
is divided into two pictures 208b and 208c by horizontal 
division means 209. Two pictures 208b and 208c are 
respectively divided by vertical division means 210a 
and 210b to obtain pictures 208d and 208e. and 208ff 
and 208g. An odd field 211 a is divided in a similar man- 
ner to obtain pictures 21 Id, 21 1e, 21 If and 21 1 g. In this 



case, the pictures 208d and 21 Id act as main signals 
and an interlace picture is output by an existing repro- 
duction apparatus. Horizontal fitters 206b and 206c and 
vertical titers 212a and 212b, inserted for preventing 

s interlace interference and the like, reduce aliasing dis- 
tortion of the reproduced picture. 
[0107] With reference to Figures 27. 28. 42 and 49, 
the file structure and identifiers for pictures will be 
described. Rgure 27 shows a togical format of DVD. 

10 Each logical block includes a video file. As shown in Fig- 
ure 28, a minimum unit of a system stream is referred to 
as a "cell". In a cell, picture data, audio data and sub 
picture are recorded in a packet in units of 1 GOP. 
[01 08] A cell 21 6 (see Figure 1 8) of a main signal of a 

15 first stream has a packet 21 7. A provider defined stream 
in the packet 21 7 has a capacity of 2048 bytes. The pro- 
vider defined stream includes a progressive identifier 
218 indicating whether the signal is progressive or inter- 
lace, a resolution kfentifier 219 indicating whether the 

20 resolution is 525, 720 or 1050. a differential identifier 
220 indicating whether or not the interpolation signal is 
a differential signal from the main signal, a filter identi- 
fier (described later), and sub stream number informa- 
tion 221 indicating the stream number of a first sub 

25 Stream. 

[01 09] With reference to Figure 52. a process for per- 
forming reproductkxn using a picture identifier 222 will 
be described. 

[0110] From the optical disK reproduction process 
30 control information 225 is first read from management 
information 224. Since the information 225 includes 
restriction information on VOB, a 0th VOB 226a is only 
connected to a first VOB 226b having a main picture in 
an existing reproduction apparatus. Since the 0th VOB 
35 226a is not connected to a second VOB 226c having an 
interpolation signal such as differential information, an 
ugly picture such as differential information is not output 
by the existing reproduction apparatus. Each VOB of the 
main signal has a picture identifier. Since the progres- 
40 sive identif ier=1 and resolution identifier=00 (525) in the 
first VOB 226b and the second VOB 226c, a progres- 
sive signal having 525 scanning lines is reproduced 
from a progressive or high definitton HD reproduction 
apparatus. 

45 [0111] In a picture identifier 222 Of the next VOB 226d, 
the progressive identifiersO and the resolution identifier 
21^10. An interlace signal having 1050 scanning lines 
is output. VOBs 226e, 226f and 226g are interpolation 
information. Thus, an NTSC signal is output by a con- 

50 ventional reproduction apparatus, an interlace signal 
having 720 horizontal pixels and 1050 vertical pixels is 
output by a progressive reproduction apparatus, and a 
full HDTV-fbrmat signal having 1050 scanning lines is 
output by a high definition reproduction apparatus. TTie 

55 picture identifier 222 can be recorded in the manage- 
ment information 224. 

[0112] With reference to Rgure 53. the relationship 
among VPTS (vkleo presentation time stamp) of the 
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sub track of interleave tAocks, i.e.. decoding output time, 
will be described. In the first VOB 226b as the main sig- 
nal, Interleave blocks 227a, 227b and 227c are 
recorded together with VPT81, VPTS2 and VPTS3. In 
the second VOB 226c, interleave blocks 227d. 227e 5 
and 227f are recorded together with VPTSI. VPTS2 
and VPTS3. A conventional player reproduces the inter- 
leave blocks 227a. 227b and 227c at IX. Since the 
main signal includes an audio signal, the audio signal is 
also reproduced. A progressive player first reproduces 
the interleave block 227d of the second VOB 226c as a 
sub signal and stores the block in a buffer memory. After 
the storage, the progressive player reproduces the inter- 
leave bk)ck 227b of the first VOB 226b. The audio and 
video signals are synchronized with ttie synchronization 
information of the interleave block 227a. Since the audio 
signal is included in the main signal, the main signal and 
the sub signal shown in parts (2) and (3) of Figure S3 
are output in synchronization with the audio signal. In 
this case, a track jump is performed between Hie inter- 
leave blocks 227a and 227e. 
[01 1 3] Thus, a progressive signal shown in part (4) of 
Figure 53 is output By checking the VPTS of the inter- 
leave blocks by the reproduction apparatus, the main 
signal and the sub signal are decoded in synchroniza- 
tion and synthesized, thereby obtaining a normal pro- 
gressive signal. 

[01 1 4] Figure 54 shows an annngement of signals in 
a simultaneous cast system by whk:h an NTSC signal 
and an HDTV signal are recorded as interleave blocks 
independently at the same time. In the VOB 227a as the 
main signal, a video signal and an audio signal 232 are 
recorded. In the VOBs 227b and 227c. an HDTV com- 
pression video signal con-esponding to about 16 Mbps 
is recorded. 8 Mbps for each, by the interleave system. 
A conventional player and a progressive player shown in 
parts (1) and (2) of Figure 54 reproduces an NTSC 
(525i) signal. An HDTV player shown In part (3) of Fig- 
ure 54 reproduces a 16 Mbps HDTV signal as a result of 
obtaining only audio data from the first VOB 227a, 
reproducing a first sub picture and a second sub picture 
from the VOBs 227b and 227c, and synthesizing these 
data. Since the reproduction of the sub signals is 
restricted by the reproduction process control informa- 
tion 225, an existing DVD player does not reproduce an 
HDTV compression signal even when the user errone- 
ously operates the player. Thus, an NTSC signal is out- 
put by the existing player, and an HPTV signal is output 
by the HPTV player. Figure 55 is a block diagram of a 
reproduction apparatus. The operation of the reproduc- 
tion apparatus is not described in detail since it is similar 
to the operations described above. A reproduction sig- 
nal from the optical disk is divided by an interleave block 
division section 233. A main signal is decoded by an 
audio decoder 230 of an NTSC decoder 229, and a first 
sub signal and a second sub signal which are each an 8 
Mbps stream, are decoded by an HDTV decoder 231. 
Thus, an HDTV signal and an audio signal are output. 



The data in the optical disk is reproduced as an NTSC 
signal even by a conventional reproduction apparatus 
by sinujltaneous casting. Moreover, according to the 
present invention, a transfer rate ol 16 Mbps is obtained 
when two Interleave streams are used. Accordingly, a 
standard HDTV MPEG-compression signal is recorded 
as it is. With a DVD, a transfer of only 16 Mbps is 
obtained with two interleave blocks. Since an HDTV 
compression video signal is a 16 Mbps signal, audio 
data cannot be recorded. According to the present 
invention, audio data of the NTSC signal of the main 
signal is used. Therefore, an audio signal can be 
recorded even when an HDTV signal is recorded with 
two interleave blocks. 

[01 1 5) Now, a method for removing interlace interfer- 
ence will be described. When a progressive signal is 
transformed into an interlace signal by removing unnec- 
essary components, aliasing distortion is generated and 
thus a moir6 of a tow frequency component is gener- 
ated. A 30 Hz line flicker is also generated. In order to 
avoid these inconveniences, the signal needs to be 
passed through interlace interference removal means. 
Interlace Interference removal means 140 is added to a 
progressive signal section of a progressive/interface 
transform section 139 of the recording apparatus in Fig- 
ure 22 (desCTibed above). When a progressive signal is 
input, the interlace interference removal means 140a 
detects a video signal having a high probability of being 
interfered with from the input progressive signal, and 
passes only such a video signal through an interlace 
interference removal filter 141. For example, in the case 
of a picture having a low vertical frequency component, 
interlace interference does not occur. In such a case, 
the filter is bypassed by a filter bypass route 143. Such 
an operation alley^iates the deterioration in the vertical 
resolution of the picture. TTie interlace interference 
removal filter 141 includes a vertical filter 142. 
[0116] In part (a) of Figure 46 (time and space fre- 
quency diagram), the hatched area represents an alias- 
ing distortion generation area 213. 
[0117] The aliasing distortion generation area 21 3 can 
be removed by a vertical filter. Specifically, as shown in 
part (c) of Figure 46, three line menK)ries 195 are pro- 
vided. Regarding a progressive signal having 480 lines, 
picture information on the target line (nth line) and pic- 
ture information on the immediately previous and sut> 
sequent lines ((n-l)th line and (n+1)th line) are added 
together by an adder 196. Thus, infbrmation of one line 
is obtained, and 240 interlace signals are generated. 
Such processing filters the information in a vertical 
direction, resulting in alleviation in the interlace interfer- 
ence. By changing the adding ratio of the three lines, fil- 
ter characteristics can be changed. This is referred to as 
a "vertical three-line tap filter". By changing the adding 
ratio of the center line with respect to the immediately 
previous and sut>sequent lines, a simpler vertical filter 
can be obtained. As shown in part (d) of Figure 46. line 
infbrmation can be processed with a vertical filter after. 
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for example, the (n-l)th line of the previous frame and 
the (n+1)th line of the subsequent frame (even lines) are 
developed on an identical space, in lieu of a simple ver- 
tical filter. Such a time vertical filter 214 has an effect of 
alleviating interlace interference, which occurs when a 
progressive signal on the optical disk is reproduced by a 
non-progressive player and only an interlace signal is 
listened. A horizontal filter 206a is realized by adding 
two pixels in a horizontal direction to synthesize one 
pixel. Needless to say, however, such a filter deterio- 
rates the resolution of the progressive picture. The filter 
effect is alleviated by preventing filtering on a picture 
having a low probability of being interfered with or by 
changing the adding ratio to realize a vertical filter. 
When the fitter effect is weakened, the deterioration in 
the resolution of the progressive picture is alleviated. A 
progressive reproduction apparatus according to the 
present invention filters the information sufficiently to 
remove interlace Interference during reproduction, so 
that it is not necessary to filter the information when 
being recorded. When such progressive reproduction 
apparatuses replace the existing reproduction appara- 
tuses in the future, filtering during recoiding will not be 
necessary. In such a case, there will be both filtered 
optical disks and unfiltered optical disks. The interlace 
interference removal means 140 outputs an interlace 
interference removal identifier 144 to check whether or 
not the picture has been filtered and records the infor- 
matnn on the optical disk 85 by recording means 9. 
[01 1 8] With reference to Figure 50. a specific method 
for recording a filter identifier will be described. A filter 
identifier 144 is put in a header in 1 GOP. which is an 
MPEG recording unit in one stream. "00" indicates that 
the signal is not filtered. "10" indicates that the signal 
has been passed through a vertical filter. "01" indicates 
that the signal has been passed through a horizontal fit- 
ter. "11" indicates that the signal has been passed 
through a vertical and a horizontal filter. Since the filter 
identifier 144 is put in the minimum unit of 1 GOP, the fil- 
ter can be turned on or off in units of 1 GOP in the repro- 
duction apparatus. Accordingly, deterioration . of the 
picture quality by double filtering is avoided. 
tO1 1 9J With reference to parts (a) and (b) of Rgure 32. 
an operation of a reproduction apparatus 86a for repro- 
ducing an optical disk 85 vtnll be described. As in Figure 
21. two interlace pictures 84a and 84b are reproduced 
to synthesize a progressive picture 93a. Notably, when 
the interlace interference removal filtering identifier 144 
is "ON" or when special reproduction such as "slow" or 
"still picture" is not performed and a progressive picture 
is not output either, an interlace signal is output directly 
by an interiace output sectton at IX. This is energy effi- 
cient. 

[01201 When special reproduction is performed or 
when the interlace interference removal filtering identi- 
fier 144 is off, a "2X' instruction 146 is sent from a con- 
trol section 147 to a motor rotation speed alteration 
sectk>n 35. Then, the optical disk 85 rotates at 2X, and 



a progressive picture is reproduced. 
[0121] A method for removing interlace interference 
when the progressive picture reproduced in this manner 
is output to an interlace TV 148 as an interiace signal 
5 will be described. When the interiace interference 
removal filtering identifier 144 is off. a determination 
switch circuit 149 is switched to pass the progressive 
signal through the interlace interference removal filter- 
ing identifier 144. Then, two frames 93a and 93b are 
10 transformed by an interlace transform section 139 into 
odd and even interiace signals 72a and 73a. Thus, an 
ordinary interiace signal is output. In this case, a picture 
with no interiace interference is displayed on the inter- 
lace TV 148. Since the interiace interference renwval fa- 
ts ter does not influence the interlace signal significantly, 
the interlace signal is not deteriorated. A progressive 
signal with no interlace interference removal filter is out- 
put to a progressive signal output section 215. By the 
system of turning on and off the interiace interference 
20 removal filter by the reproduction apparatus, a progres- 
sive picture with no quality deterioration and an inter- 
lace picture with no quality deterioration such as 
interlace interference are both obtained. 
[0122] When slow reproduction of a speed of 1/2 or 
25 less and still picture reproduction is performed, the 
removing filter is weakened since the interlace interfer- 
ence is alleviated. 

[01 23] Next, a method for improving special reproduc- 
tion will be described. When an instruction to perform a 
30 slow or still picture reproduction is issued from the con- 
trol section 147 through an operation input section 150 
to slow^ll picture reproduction means 151. the inter- 
lace transform section 149 divides the 480 lines of the 
frame 93a into two fields using a frame processing see- 
ds tion 152 to create and output an odd interlace signal 
72b and an even interlace signal 73b. Then, a low or still 
interlace picture having a resolution of 480 with no blur- 
ring is displayed on the interlace TV 148. In a conven- 
tional interlace reproduction apparatus, the resolution 
40 needs to be lowered to 240 in order to obtain a slow or 
still picture with no blunging. According to the present 
invention, a stow or still picture having a resolution of 
480 with no blurring is obtained by transforming the 
interiace signal into a progressive signal once and then 
45 transforming the progressive signal back to the interiace 
signal. Figure 32 illustrates this process in the flowchart 
in part (a) (steps 153a through 153g). The detailed 
description of the flowchart is omitted. 
[01 24] Witii reference to Figure 26. a mettiod for out- 
50 putting streams in two channels continuously will be 
described. The two-channel streams are recorded on 
an optical disk as pictures in cameras 1 and 2 by an 
interleave system. A first stream from tiie disk is repro- 
duced and then switched to a second stream. 
55 [0125] Wrth reference to Figure 35. a method for 
switching a specific stream to another stream smoothly 
with no disconnection when the contents of the optical 
disk include a plurality of streams, i.e., when a plurality 
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of streams are multiplexed will be described. As shown 
in part (1) of Figure 35, an optical disk 106 includes two 
different streams as a first stream 111 of a first video 
signal and a second stream 1 12 of a second video sig- 
nal. The two streams are basically recorded substan- 
tially at the same radius. 

[0126] Usually, only the first video signal as a basic 
stream is reproduced. Accordingly, a first stream 1 11 a is 
reproduced and then a first stream 111 b is continuously 
reproduced. When the user issues an instruction to 
switch the first video signal to the second video signal 
from an instruction input section 19 In Figure 5 at time 
tstc, a tracking control circuit 22 in Figure 5 is used to 
access a track at a different radial position, thereby out- 
putting a second stream 112b of the second video sig- 
nal at time t:=tc. 

[0127] Thus, as shown in part (2) of Figure 35. the first 
video signal is switched to the second video signal 
seamlessly with no disconnection at time t»tc In terms 
of the video, audio and sub picture signals. 
[0128] A method for realizing such a seamless repro- 
duction by synchronizing the video, audio and sub pic- 
ture signals will be described later. 
[01 29] With reference to a timing diagram of parts (3) 
and (4) of Figure 35, a specific method for reproducing 
data will be described. As described with reference to 
the bk)ck diagram of Figure 22, a progressive picture as 
the first video signal is divided into main interlace video 
signals A1 through An (Odd Rrst) and sub interlace 
video signals B1 through Bn (Even First). TTie signals 
are recorded separately in first-angle and second-angle 
sub channels. Although not described with reference to 
Figure 22. a progressive picture as the second video 
signal is also divided into main interlace video signals 
CI through Cn and sub interlace video signals D1 
through Dn. The signals are recorded separately In 
third-angle and fourth-angle sub channels as shown in 
part (3) of Figure 35. Part (3) of Figure 35 is a timing dia- 
gram of the principle shown in Figure 36. The operation 
Is the same. 

[01 30] Figure 36 puts a focus on an interleave section 
of the recording apparatus shown in Figure 22. A pro- 
gressive signal as the first video signal is divided by a 
first video signal division section 78a Into a main signal 
(Odd Rrst) and a sub signal (Even First). The amount of 
information can be reduced by finding a differential sig- 
nal between the main signal and the sub signal by a dif- 
ferential section 1 16a and compressing the main signal 
and the sub signal to be recorded on the disk In the 
case of a progressive signal, the correlation between 
adjacent odd and even lines is quite strong, and accord- 
ingly the amount of information of a differential signal 
between the two lines is small. Thus, the amount of 
information to be recorded can be significantly reduced 
by finding the differential signal. 
(01 31 ] According to the present invention, the signals 
are recorded In a divided manner using the differential 
device 116a as shown in Figure 44. A 720P signal, i.e., 



a progressive picture having 720 lines or a 1050P signal 
is divided by tiie picture division section 115 into 525 
basic information 187, progressive picture 183 (or 525 
interlace picture 184) and interpolation information 186. 

5 Differential information 185 between the basic Informa- 
tion 187 and the interpolation information 186 Is 
obtained by the differential device 1 1 6a. The differential 
information 185 is divided by a second video signal divi- 
sion section 78c and a third vkleo signal division section 

10 78d into four streams 188c. 188(1. 188e and 188f. 
These streams are sent to a compression section 103 
and processed with interleaving by an interleave section 
113a. Thus, six streams are recorded in the angles on 
an optical disk 187. 

IS [0132] Attiiispoint, the sti-eams 188c. 188d,188e and 
1881 are differential information or interpolation informa- 
tion, and thus do not provide a normal picture when 
being decoded by the reproduction apparatus and out- 
put onto a TV screen. Such an abnormal picture makes 

20 Uie viewer feel uncomfortable. In order that the streams 
188c. 188d. 188e and 188f. including the interpolation 
information 186, recorded in different angles not be out- 
put by a non-progressive reproduction apparatus, 
restriction information is generated by the picture output 

25 restriction information generation section 179 and 
recorded on the optical disk 187. Specifically, such infor- 
mation prevents a specific stream from being opened 
without a password. Processing the streams 188c, 
188d. 188e and 188f witii such password protection 

30 prevents a conventional reproduction apparatus from 
opening these streams and avoids the situation where 
the user views the abnormal picture obtained by decod- 
ing the interpolation information. 
[01 33] Returning to Rgure 36, the first video signal is 

35 tfius compressed, so ttiat the main signal of the first 
video signal is divided into A1 and A2 interleave blocks 
83b and 83d. each including 1 GOP or more. The main 
signal of tiie second vkleo signal is divided into C1 and 
C2 interleave bfocks 83a. The sub signal of the second 

4c video signal is divided into 81 and B2 interleave blocks 
836 and 83g and D1 and D2 interleave blocks 83f and 
83h. As shown in Figure 36, a recording stiream 117 is 
generated from these four pieces of data. In the record- 
ing stream 1 17. the blocks are arranged In the order of 

45 A1, B1, CI. D1, A2. B2, C2. and D2. The recording 
stream 1 17 is recorded on an optical disk 1 1 5 by record- 
ing means 145. A1. 81, A2 and B2 correspond to the 
first video signal of the progressive signal. Accordingly, 
tiie signals are recorded on the optk^al disk 115 in the 

50 order of the first video signal, the second video signal, 
the first video signal and the second video signal. A 
seamless reproduction performed by the AV synchrorti- 
zation section will be described later. 
[01 34] In the above description, 1 GOP or more of the 

55 MPEG signal is recorded in each interleave block. Pre- 
cisely, one interleave block is restricted to atxxjt 0.5 
seconds or less. Therefore, only 30 fields of a video sig- 
nal can be recorded at the maximum. Accordingly, only 
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30 GOPs can be recorded in one interleave block at the 
maximum. One interleave block of the present invention 
is limited to 1 GOP or more and 30 GOP or less. 
[0135] A method for corTY)ressk)n will be described. 
Interlace signals 79a and 80a of a first VOB 118 are put 
together as a field pair 125a and encoded by a frame 
encoding sectton 123a into a franne encoded signal 
127a. 

[0136] A dummy field 1 21 of a second VOB 1 1 9 is first 
encoded by a field encoding section 124b in a compres- 
sion section 82b on a fieid-by-field basis into a field 
encoded signal 129. Next, an even interlace signal 80b 
and an odd interlace signal 79b, which are sub signals, 
are put together as a first field pair 126a, frame- 
encoded by a frame encoding section 123b in the com- 
pression section 82b into a frame encoded signal 128a. 
(01 37] Thus, an Odd First dummy field is added to the 
second VOB 119. Thus, the second VOB signal 119 
starts with an odd interlace signal. Since the signals are 
recorded in the order of an odd interlace signal and then 
an even interlace signal, the signals are reproduced 
smoothly by a DVD player. In this case, one progressive 
signal conresponds to frame encoded signals I27a and 
1 28a. Due to the field encoded signal 1 29 obtained from 
the dummy field, there is an offset time period 130 of td 
between the frame encoded signal 127a from tiie main 
signal and the frame-encoded signal 128a from the sub 
signal. Accordingly, it is required to output the sub signal 
earlier by the offset time period when reproducing the 
progressive signal. 

[0138] With reference to Figure 34. the operation of 
the reproduction apparatus 86 described refening to 
Figure 21 will be desaibed in more detail. A signal from 
the reproduction section 95 is divided into a first VOB 
118 as the main signal and a second VOB 119 as the 
sub signal. The first VOB 118 originally starts with an 
odd line and thus can be extended as it is. The second 
VOB 1 18 has a dummy f ieU 1 29 at the start thereof for 
authoring. Reproduction of the second VOB 1 18 as it is 
results in generating an offset time period 119 of td 
between the main signal and the sub signal. Since it is 
time-consuming to synthesize the first progressive sig- 
nal in such a case, a picture oon'esponding one VOB 
and a picture corresponding the next VOB are not con- 
tinuous, tn order to avoid this, the present invention pro- 
vides two method for skipping a dummy field 121 . 
[0139] According to a first method, a fiekl encoded 
signal 129 at the start of the second VOB 119 is once 
input to an extensfon section 132. When progressive 
identification information is detected during or after field 
extension, a progressive processing switching section 
135 is switched to Yes. Thus, the dummy field 121 is 
skipped by dummy field bypassing means 132 so that 
an even interlace signal 80b is first output and then an 
odd interlace signal 79b is output. This signal is syn- 
chronized by synchronization means 133 with an audio 
signal 134 and a sub picture signal 135 such as subti- 
tles which are recorded in the main signal. As a result. 



progressive pictures 93a and 93b are output through a 
progressive transform section 90. In the embodiment 
where the dummy field 1 21 is bypassed in this manner, 
an odd field and an even field are output in synchroniza- 

5 tton with each other. Thus, a progressive signal, an 
audio signal and a sub picture signal with matching time 
axes are output. When progressive identification infor- 
mation is absent, the progressive switching section 135 
is switched to No, and thus the dummy fiekJ 121 is not 

10 bypassed. Progressive transform is not performed. 
Thus, an interlace signal 136 is output. Such an output 
of the interlace signal 136 occurs in a conventional DVD 
player without a progressive function. As described 
above, the dummy field bypassing means 132 is turned 

IS on for processing a progressive signal. Othenwise, the 
dummy field bypassing means 132 is turned off, so that 
an ordinary field encoded interlace signal is normally 
output without dropping the field. 
[0140] A second method is used when the dummy 

20 field 1 29 is field-encoded into 1 GOP frames and can be 
separated from the frames of the sub signal. Before 
decoding, the field encoded signal 129 obtained by 
encoding the dummy field is skipped by 1 GOP by 
dummy field encoded information bypassing means 

25 137. The skipped information is input to a buffer 131b, 
or skipping is performed when data is output from the 
txjffer. To the extension section 88b, only the frames of 
the sub signal paired with the main signal or f ieki infor- 
mation is input. Thus, by ordinary means described 

30 dbove referring to Figure 21 , the even interlace signal 
80 and the odd interlace signal 79b are extended, inter- 
lace-transformed, synchronized with the main signal, 
and transformed into progressive signals 93a and 93b 
by the progressive transform section 90. 

35 [0141] According to the second method, tiie dummy 
field is removed while the dummy field is in the form of 
the encoded information. Therefore, the dummy field is 
not required to be processed by ttie buffer section 131b 
or the extension section 88. This method is appropriate 

40 for putting a field encoded in units of 1 GOP to the start 
of the second VOB. 

[01 42] According to the first method, the dummy fiekl 
129 and tiie fieU signals in each frame 127a are fieki- 
encoded togettier to generate a unit of 1 GOP. This is 
45 efficient where a dummy field is inserted at the start of 
one interleave block in. for example, a seamless multi- 
ple angle system having a high recording efficiency. The 
first method has an effect of extending tiie recording 
time perfod. 

50 [0143] By skipping the dummy field 121 only for pro- 
gressive processing in this manner, progressive pic- 
tures can be reproduced with no disconnection at the 
border between adjacent VOBs or between interleave 
blocks in tiie case of a seamless multiple angle system. 

55 [0144] Such processing will be described with refer- 
ence to the flowchart in Figure 37. In step 138a. an 
instruction to start reproduction of (2n-1)tti angle data is 
issued. In step 138b, whether or not a progressive iden- 
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tifier is present is checked. If yes, the processing junps 
to step 138f. If no, in step 138c, whether or not the fbl- 
iowing three conditions are fulfilled is checked. Condi- 
tion 1 is that there is one field (or an odd number of 
pieces of fields) of GOP at the start of the nth angle 
VOB. Condition 2 is that one field of GOP is not existent 
continuous to one field of GOP. Corxiition 3 is that the 
leading GOP of the (2n-1)th angle does not correspond 
to one field. Then, in step 1 38d, whether or not the three 
conditions are fuHiiled is checked. If no. in step 138e. 
interlace processing is performed to output only the (2n- 
1)th angle. If yes. in step 138f, the processing is 
switched to progressive processing. In step 138g, 
whether or not the reproduction is to be peribrmed from 
the start of the (2n-1)th angle VOB is checked. If no, the 
processing jumps to step 138j. If yes, in step 138h, the 
nth angle VOB is output while dropping the picture of 
the first one field or GOP corresponding to one fieM. 
When the (2n-1)th angle includes an audk) signal, the 
VOB is output while skipping the first offset time period 
dt (default value: 1/60 sec.). In step 138J. the main sig- 
nal of the (2n-1)th angle and the sub signal of the 2n'th 
angle are decoded, synchronized and synthesized into 
a progressive signal. In step 138k. a progressive picture 
is output. When a seamless multiple angle output is per- 
formed in step 138m. the processing advances to step 
138n. where each Interleave t>lock of the (2n-1)th angle 
(i.e., sub signal) is field-decoded, and the output Is per- 
fbrmed while the first block is skipped. AHernafively, the 
outputting order of the odd lines and the even lines is 
inverted at the time of interlace transform. In step 1 38p, 
the progressive picture is synthesized and output. 
[014Q Due to authoring, several seconds of dummy 
field is inserted at the start of the multiple angle VOB. 
The dummy f ieW group at the start of the VOB is read. 
In a similar manner, the leading address at which the 
nrult^e angle VOB starts is read from the PGC data. 
For ordinary reproduction, data is read from the start of 
the VOB. Rx* only 3D or progressive reproduction, the 
dummy field is skipped and the data is read from the 
starting address of the VOB corresponding to each of 
the multiple angle VOB. Thus, 3D or progressive pic- 
tures are prevented from being interrupted at the border 
of adjacent VOBs. 

[0146] So far, the MADM system has been described. 
Hereinafter, a provider defined stream picture cfivision 
multiplex system (PSDM) as another system will be 
described. Figure 61 is a block diagram of the PSDM 
system of a vertteal division system. Figure 62 is a block 
diagram of the PSDM system of a horizontal division 
system. Figure 63 shows a signal format of the PSDM 
system. 

[0147] As shown in Rgure 63. a DVD video signal has 
10.08 Mbps, and a provider defined stream is defined 
separately from a basic stream. A sum signal described 
with reference to Figure 23 can be added to the basic 
stream and put into the provkter defined stream. Such a 
signal can be reproduced by changing the circuit even 



with a normal IX drive. According to the experiments 
performed by the present inventors, a satisfactory pro- 
gressive picture is obtained when the sum signal is 6 
Mbps and the difference signal is 3 Mbps. Thus, a satis- 
5 factory progressive picture is obtained unless the 
encoding is difficult. 

[0148] In the case of a movie, which contains a pro- 
gressive picture of 241 frames, a sufficient picture is 
obtained by the PSDM system. The system shown in 

10 Figure 61 is basically the same as those shown in Fig- 
ures 22 and 23. In the latter half of the production of the 
disk, a sum signal is recorded in the t>asic stream with a 
basic stream identifier being added thereto in an author- 
ing section, and a difference signal is recorded in a pro- 

15 vider defined stream with a provider defined stream 
identifier being added thereto. In the case of a movie, a 
3-2 transform identifier synchronized with the sum and 
difference signals is added. 

[0149] The reproduction apparatus decodes the sum 
20 signal from a packet provided with the basic stream 
identifier 267 by a first decoder 69a, and decodes the 
difference signal from a packet provided with the pro- 
vider defined stream identifier 268. Signals A and B are 
obtained by a sum calculatton section 250 and a differ- 
25 ence calculation section 251. Thus, a 525P signal is 
synthesized. 

[01 SO] Figure 62 shows a system for dividing a wide 
525P signal in a horizontal directton and PSDM-record- 
ing the resultant signal as two interlace signals, like in 
30 Figure 58. 

[01 51 ] With reference to Figure 26 and part (3) of Rg- 
ure 35, a process for reproducing the optical disk 155 
and switching the first video signal to the second video 
signal at tstc will be desaibed. As shown in Rgure 26, 
35 the optical disk 1 55 (provided as an example of an opti- 
cal medium) has four channel stream recorded by an 
interleave system. The streams are recorded in the 
order of A1 . B1 , CI . D1 , A2, B2. C2, D2. A3, B3, C3 and 
D3 in interleave units of 1 GOP. Since the first vMeo sig- 
40 nat is first output, interleave blocks (hereinafter, referred 
to simply as "ILB") 84a and 84b(i.e.. A1 and B1) are 
continuously reproduced and a track jump 156 is per- 
formed, thus reproducing ILBs 84e and 84f (i.a, A2 and 
B2). When the first video signal is switched to the sec- 
45 ond video signal at t=tc. a track jump 1 57 is performed, 
thus reproducing ILBs 841 and 84h (i.e.. C3 and D3). 
Thus. A1, A2 and C3 as main signals and B1. B2 and 
D3 as sub signals are reproduced, extended by the 
extension section, and sent through the synthesis see- 
so tion 1 01 b to the output section 1 1 0b. The resultant sig- 
nal is synchronized with a sub picture signal from a sub 
picture decoder 159 and an audio signal from an audio 
signal reproduction section 1 60 by the AV synchroniza- 
tion section 158. Thus, these signals are output with 
55 matching timing. Accordingly, the progressive signal in 
the first stream and the progressive signal in the second 
stream are reproduced seamlessly with no disconnec- 
tion. A method for synchronizatkin for providing a seam- 
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less reproduction will be described later. 
[0152] With reference to Figure 45. a method for syn- 
chronizing two picture signals and an audio signal when 
two streams are simultaneousty reproduced as in the 
case of. for example, a 3D picture or scope picture will s 
be described. When three or four streams are simulta- 
neously reproduced as in the case of a 720 P signal, a 
similar method is usable and will not be desaibed. 
[0153] Rrst. a method for synchronizing two streams 
according to the present invention will be described. 
First, as shown in Figure 39, a system reproduced from 
the optical disk is once accumulated In a track buffer 23 
and then sent to a first video decoder 69d and a second 
video decoder 69c. In the track of the optical disk, a first 
stream A and a second stream of the progressive signal 
are alternately recorded on an interleave block-by-inter- 
leave block basis. 

[0154] First, the stream A is reproduced at 2X rotation, 
and data accumulation in a first track buffer 23a of the 
track buffer 23 is started. As shown in part (1) of Figure 
45, when t=t1 to t2, data for 1 interleave block (ILB) II of 
the first video signal for 1 interleave time T1 is accumu- 
lated. A first track buffer data amount is increased, and 
becomes equal to 1 ILB at t::^. Thus, data accumula- 
tion for 1 ILB of the first video sigr^l is completed. At 
t=t2. after accumulation of data for 1 ILB of the first 
video signal corresponding to 1 GOP or more is com- 
pleted, the second video signal (stream B) is repro- 
duced from the optical disk starting from the interleave 
block 12. As shown in the solid line in part (4) of Figure 
45. data accumulation of the second video signal in a 
second track buffer 23b is started at t=t2 and continued 
until t=t6. From t=t2 through tS, as shown in parts (7) 
and (10) of Rgure 45, the video presentation stamps 
(VPTS) of the first video signal and the second video 
signal are synchronized and respectively sent to the first 
video decoder 69c and the second video decoder 69d 
from the track buffer 23a and the track buffer 23b. As 
shown in parts(8) and (11) of Figure 45. the input sig- 
nals are output as two pieces of video data after being 
extended by the first and second vkJeo decoders 69c 
and 69d. The output of these pieces of data starts at 
tats, which Is delayed by a video delay time period twd. 
which is required Ibr MPEQ extenston of the data. From 
t=t4 through tlO, the streams A and B are synthesized 
into a progressive signal by a progressive transform 
section 170. Thus, a progressive signal for one inter- 
leave block is output. 

[01 55] As described above, from t-t2 through t8. data 
for one interleave block is input to the decoders. Accord- 
ingly, the data in the first track buffer 23a and the data in 
the second track buffer 23b are consumed and reduced 
at substantially the same rate. Therefore, as shown in 
part (2) of Figure 45. the data amount in the first track 
buffer is reduced from tst2 through t7. At tst7, the data 
amount is 1/2 of 1 ILB. Since data reproduction for the 
interleave block 15 starts at tBt7. the data amount 
increases until t^td, when the data amount reaches 1 



ILB. Since data input to the first decoder 69c starts at 
t=t8 as at t=t2, the data amount reduces until t=t11. 
Finally, the buffer memory amount becomes 1/2 ILB. 
[pi 56] With reference to part (4) of Figure 45. a 
change in the memory amount in the second track 
t>uffer 23b for stream B will be described. At t=t2. input 
of data B1 for the interleave t)lock 12 of stream B in the 
second track buffer 23b starts. At the same time, trans- 
fer of data B1 to the second vkleo decoder 69d starts. 
Accordingly, the buffer amount at t=t6 is 1/2 ILB. When 
2-angle recording of a progressive signal according to 
the present invention is performed, it is necessary to 
perform a track jump to the interleave block 15 over the 
interleave blocks 13 and 14 since there are four streams, 
i.e., four interleave blocks. During the jump period 197 
(tj), data input from the optical disk is interrupted. Thus, 
the buffer amount of the stream B is reduced until t=t8, 
when the buffer amount is dose to zero. 
[01 57] Since input of data B2 of the interleave block 16 
starts at t=t8. the buffer amount starts increasing again. 
At t=t1 1 , the memory amount of the second track buffer 
is 1/2 ILB. At t=t11, a track jump to the interleave block 
19 of A3 over the interleave blocks 17 and 18 is per- 
formed. 

[01 58] The atxjve-described operation is repeated. 
[0159] Now, the minimum necessary mennory capac- 
ity for a track buffer 23 (total capacity of the first and sec- 
ond track buffers 23a and 23b) according to the system 
of the present inventton will be checked. A track buffer 
capacity 1 98 indicated by dotted line in part (4) of Figure 
45 shows the total data amount in the first and second 
track buffers 23a and 23b. A continuous reproduction is 
realized by setting the total capacity of a minimum 1 1LB 
in the track buffer. 

[0160] Accading to the present invention, the total 
capacity of the track buffers 23a and 23b is set to be 1 
interleave block or more for progressive reproduction. 
Thus, overflow and underflow of the track buffer are pre- 
vented. A method for switching the system dock STC 
between two streams will be described with reference to 
Figure 31 . A progressive signal indudes two streams A 
and B. Here, the streams of two interlace signals form- 
ing a 1 ILB progressive signal are referred to as A1 and 
81 . As shown in part (1 ) of Figure 31 . data A1 for stream 
A is reproduced during the 1/2 ILB time period and all 
the data is recorded in the buffer. Then, as shown in part 
(2) of Figure 31. data for stream B is reproduced as B1 
and stored in the buffer after A1 is reproduced. Since 
the data reproduced from the optical disk is restrk;ted 
with stream B (part (2) of Rgure 31) as described 
above, the track buffer does not overflow. Stream A 
(part (3) of Figure 31) or stream dock (SCR) from the 
track buffer for stream B Is reset substantially in syn- 
chronization with the start J of the reproduction of 
stream B (part (2) of Figure 31). Since stream B is out- 
put at the speed of 2X, the stream dock is counted at 
the speed of IX as shown in part (3) of Rgure 31. I.e., 
at half the speed of stream B due to the buffer. At point 
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G, the stream dock is reset. Time VPTS2 at which the 
video signal for stream B Is output needs to be synchro- 
nized with time VPTS1 In consideration of the delay time 
period Tvd due to. for example, MPEG decoding time 
period. In this case, at point I (t-Ti), when the VPTS 
stops rising. AV synchronization control is restarted. By 
checking VPTS2 of stream B and synchronizing VPTSI 
of stream A to VPTS2. synchronization is realized by 
one-system simple control. VPTSI can be used addi- 
tionally. 

[01 61 ] Audio data of synchronizing stream B is repro- 
duced and the system clock is switched at point M using 
APTS of stream B as shown in part (4) of Figure 31. 
Regarding a sub picture signal of stream B, the system 
clock can be switched in a similar manner. 
[01 62) By using data of stream B with priority, AV syn- 
chronization is realized with simple control. 
[01 63] All the data in streams. A1 and A2 is stored in 
the buffer memory, the buffter memory does not over- 
flow. Stream B1 may possibly overflow. However, 
according to the present invention, the synchronization 
control is performed using stream B and the system 
clock is switched to control the signal flow so that 
VPTS2 does not exceed the VPTS threshold level as 
shewn in part (6) of Rgure 31. Therefore, the buffer 
does not overflow. 

[0164] According to the present invention, the audio 
signal of stream B is used for audio reproduction. 
Therefbre, the buffer amount of audio decoder is 
reduced to 1/2. Furthernrore. by the system dock is 
switched at point H (t=Th) as shown in part (4) of Figure 
31, the audio signal is reproduced smoothly without 
exceeding the APTS threshold level. The sub picture 
information is also reproduced with smooth synchroni- 
zation. Accordingly, picture, audio and sub picture (sub- 
titles or the like) signals are synchronized, and picture 
and audio are reproduced seamlessly. The audio signal 
and the sub picture signals of stream A can be omitted. 
In the embodiment where the audio and sub pidure sig* 
nals are put into stream B so that stream B2 is repro- 
duced by an existing reprodudion apparatus, and 
reprodudion of stream A is controlled by the second 
video signal output control infbrnr^tion provision sedion 
179; a pidure with no audio signal is prevented from 
being output. By omitting the audio and sub picture data 
of stream A. progressive pidure software, for example, 
a 2-hour movie, can be recorded in one two-layer disk 
by the interleave block recording system according to 
the present invention. Such an effed will be described. 
In the case of a movie, data for about 2 hours and 1 5 
minutes can be recorded on a one-layer 4.7 GB DVD. In 
order to perfbrm 2-channel recording of a progressive 
pidure without finding a differential, 9.4 GB is required. 
A pidure signal requires 4 Mbps, and sub picture and 
audio signals require almost 1 Mbps. When the audio 
signal of 1 Mbps is recorded in one stream, a total of 
only 9 Mbps is suff ident In other words, only 90% of the 
data amount i.e., 8.5 GB (90% of 9.4 GB) is suffident 



Therefore, a two-layer disk accommodates the data for 
one layer and a progressive signal. 
[0165] The synchronization method of the present 
invention fundbns as follows. Where an interleave 

s block of stream A is recorded first and then an interleave 
block of stream B is recorded on the optical disk, when 
the first data (e.g., stream A) is stored in a track buffer 
and the next data (e.g., stream B) is reproduced, the 
synchronization Information of stream B is mainly used. 

10 Specifically, the system clock is switched so that the 
video time stamp of stream B (VPTS2) does not exceed 
the tiireshoU value of VPTS2. In this manner, video and 
audio signals are reproduced in synchronization with 
each other with no disconnection. Stream A can be read 

IS from the buffer in synchronization with the time informa- 
tion such as VPTS2 (time stamp of sfream B). Thus, the 
control is simple. 

[0166] As desaibed above, according to the present 
invention, the first stream is once accumulated in a 

20 buffer and only tiie second stream is processed witii 
synchronization. Thus, the conf ol is accurate and sim- 
ple. Overflow and underflow can be prevented by setting 
tiie size of the buffer memory to be 1 1LB or more. 
[0167] An existing DVD reproduction apparatus uses 

ss a 100 to 300 kB buffer memories, which is about 1/5 of 
the standard 1 ILB. According to the present invention, 
smooth reproduction is performed with the standard 1 
ILB buffer memory. 1 ILB corresponds to 0.5 to 2 sec- 
onds. Since the wait time period in the case of multiple 

30 angle reprodudion can be only about 1 second. 1 ILB is 
adually considered to correspond to 0.5 to 1 second. In 
order to handle an 8 Mbps sti-eam corresponding to 1 
second, a buffer memory of 1 MB or more is usable in 
the reprodudion apparatus according to the present 

35 invention. 

[01 68] The synchronization control section 1 66 in Fig- 
ure 30 can switch the system clock using the synchroni- 
zation data regarding the interleave blocks 12 and 16 of 
the second video signal to realize seamless reproduc- 

40 tion between interleave blocks. During data reproduc- 
tion for interleave blocks 12 and 16. the motor rotation 
speed reprodudion track is controlled while monitoring 
tiie buffer amount of stream B. Thus, the memory 
anrnunts of the track buffers 23a and 23b can be opti- 

45 mized so as not to overflow. All the data for the inter- 
leave blocks 12 and 16 of stream A is in the track txjffer 
23a and is not suitable to optimize the buffer size. When 
audio data of the interleave blocks II and 15 is used for 
reprodudion, it is required to accumulate the one inter- 
so leave block or more of audio data and sub |»cture data 
in the track buffer 23 (Figure 39) and tiie audio decoder 
buffer 172 (Figure 39) as shown in part (3) of Figure 45 
in order to match the time stamp of the audio data witii 
the time stamp of the video output of parts (8) and (1 1) 

55 of Figure 45. By corrtrast. when the audio data of tiie 
interleave blocks 12 and 16 is used. 1/2 ILB data is suffi- 
dent as shewn in part (5) of Figure 45. Accordingly, the 
required memory amount of the track buffer 23 (Rgure 
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39) and the audio decoder buffer 172 (Figure 39) is 
reduced to half. 

[0169] As shown in Figure 45, for reproducing data of 
irrterleave blocks 11 and 12 including the main signal of a 
progressive signal and data of interleave blocks 15 and 
16 including the interpolation of the progressive signal, 
the interleave blocks 15 and 16 can be stored in the 
buffer and then the motor rotation can be controlled 
based on the reproductron data regarding the interleave 
blocks 12 and 16. Thus, the memory amount of the buffer 
is reduced. The system clock of the AV synchronization 
control section 158 in Figure 30 can be switched based 
on the system clock of the interleave blocks 12 and 16. 
Thus, stable decoding is realized without causing the 
buffer to overflow. 

[01 70] The method of skipping the first field of a V08 
of a progressive signal is described with reference to 
Rgure 37. A second practical method is carried out with 
the recording apparatus 99 shown in Figure 22. Among 
an Odd First identifier 199 obtained by interlace trans- 
form and an Even First identifier 200, only the Even First 
klentif ier 200 is transformed by an Even/Odd transform 
section 201 into an Odd First kientif ier 202 and provkied 
to each piece of MPEG data. Thus, all the VOBs start 
with an Odd First identifier. 

[0171] As shown in Figure 21, the reproduction appa- 
ratus reproduces the data regarding the Odd First iden- 
tifier 199 and the data regarding the Odd First identifier 
202 obtained from the Even First identifier. In step 203, 
it is checked whether or not a progressive signal is 
reproduced, if yes. in step 204, the Odd First identifier of 
the second video signal is transformed into an Even 
Rrst klentifier 200a and sent to the Interlace transl6rm 
section 71 b of the MPEG decoder. If no, the identifier is 
not transformed. The interlace transform section 71b 
outputs the field of the frame picture of the second vkieo 
signal first Thus, an Even First pkAire is output. The 
synthesis section 90 synthesizes the Even First picture 
of the second video signal and the Odd First picture of 
the first vkJeo signal and outputs a normal progressive 
picture. By this method, all the interleave blocks start 
with an Odd First picture, and thus seamless multiple 
angles are reproduced with no problem by a DVD repro- 
duction apparatus. Since each interleave block is 
restricted to start with an Odd First picture for seamless 
multiple angle reproduction, the dummy fieU need not 
be inserted. Thus, the recording efficiency is not 
reduced. 

[0172] According to the second method of even/odd 
transform, the first video signal is normally reproduced 
even with an existing reproduction apparatus. However, 
when interlace transform is performed in accordance 
with the Odd First kientifier of the second vkleo signal 
by the existing reproduction apparatus, the odd field and 
the even field are inverted. Thus, a low quality picture 
with a lower resolution is output. In order to avoid this, 
when a conventkinal reproduction apparatus is used, 
infbrmatton regarding the restriction on the reproduction 



of the second vkJeo signal by the DVD format is 
recorded on the optical disk 85 by the second video sig- 
nal output restriction information provision section 
described with reference to Figure 40. Thus, the second 
video signal is not reproduced by the existing reproduc- 
tion apparatus, and the situatbn where the user views 
unpleasant picture is avoided. 
[01 73] With the recording apparatus, an Odd Rrst pic- 
ture (field picture) and a transformed Odd First picture 
(field picture), k>oth of which are fieU pictures, are com- 
pressed respectively by compression sections 81a and 
81b by variable encoding. When motion detection and 
compensation are performed separately, encoding of a 
picture which is diffkuilt to compress results in separate 
Uock distortions. When such encoded signals are syn- 
thesized into a progressive signal, the decoded picture 
is deteriorated with noise. In order to avoid this, motion 
d^ection compensation is performed with an identical 
motion vector t>y one motion detection/compensation 
section 205 for encoding. Such processing matches the 
block distortion when the two fields are decoded. The 
matched block distortion is less conspicuous. Further- 
more, the load for encoding is reduced. 
[0174] Next, an operation of the AV synchronization 
section 1 58 will be described in detail. 
[0175] The AV synchronization section is one of the 
most important sections of the present invention, 
[pi 76] Rrst, an operatton of a system control section 
in Rgure 5 will be described. The system control section 
21 determines whether or not an optical disk has been 
set (inserted) in the reproduction apparatus. Once the 
optical disk is detected to be set, the system control 
section 21 controls a mechanism control section and a 
signal control section to control the disk rotation until 
stat>le reading is performed. When the stable reading is 
performed, the optical pickup is moved to read a volume 
information file shown in Figure 28. 
[jOITT] The system control section 21 further repro- 
duces a program chain group for a volume menu in 
accordance with volume menu management informa- 
tion in the volume information file shown in Figure 28. 
When the program chain group for the volume menu is 
reproduced, the user can designate data numbers of 
desired audio data and sub picture data. Reproduction 
of the program chain group for the volume menu during 
the reproduction of the data on the optical disk can be 
omitted when it is not necessary for the specific use of 
the multi-media data. 

[01 78] The system control sectton 21 reproduces and 
displays a program chain group for a title menu in 
accordance with title group management information in 
the volume information file. Thus.the system control 
sectton 21 reads the file management infdrmation of the 
video file including the title selected based on the user's 
selection and is directed to the program chain at the 
start of the title. The program chain group is repro- 
duced. 

[0179] Rgure 29 is the flowchart showing a detailed 
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process of reproduction of the program chain group per- 
formed by the system control section 21. As shown in 
Figure 29, in steps 235a. 235b and 235c, the system 
control section 21 reads corresponding program chain 
information from the volume information file or a pro- s 
gram chain infomiation table of the video fie. When the 
program chain is not completed in step 235d, the 
processing advances to step 235e. 
[0180] In step 235e, it is determined whether or not 
the current cell and the immediately pret/ious cell should 
be connected seamlessly referring to seamless connec- 
tion instruction infbrmation for the cell to be transferred 
next in the program chain infbrmation. If yes, the 
processing goes to step 235f for seamless connection 
processing. If no, ordinary connection is performed. 
[0181] In step 235f. the mechanism control section 
and the signal processing section, for example, are con- 
trolled to read DSI pacl<ets, so that VOB reproduction 
end time (VOB_E_PTM) in the DSI packet of the cell 
which has been transferred and VOB reproduction start 
time (VOB_S_PTM) in the DSI packet of the cell to be 
transferred next are read. 

[0182] In step 235li, "VOB reproductk>n end time 
(VOB_E_PTM) - VOB reproduction start time 
(VOB_S_PTM)" is found. The resultant value is sent to 
the STC offset synthesis section 164 in the AV synchro- 
nization control section 158 in Figure 30 as an STC off- 
set value between the current cell and the immediately 
previous cell which has been transferred. 
[0183] Simultaneously. In step 2351. VOB reproduction 
end time (VOB_E_PTM) is transferred to an STC switch 
timing control section 166 as switching time T4 for an 
STC switch 162e. 

[0184] The system control sectton 21 then instructs 
the mechanism control section to continue reading data 
until the terminal position of the current cell. Thus, the 
data for the current cell is transfen-ed to the track buffer 
23 in step 2351. Upon completion of the transfer, the 
program chain information is read in step 235c. 
[0185] If it is determined a seamless connection is not 
necessary in step 235e, the data is transferred to the 
track buffer 23 until the end of the system stream, and 
then program chain information is read in step 235c. 
[0186] Hereinafter, two examples of a method for AV 
synchronization control for seamless connection and 
seamless reproduction will be described. In other 
words, the AV 8ynchronizatk)n control section 158 
shown in Rgures 26 and 39 will be described in detail. 
[0187] Referring to Rgure 39, a system decoder 161 , 
an audio decoder 160. video decoders 69c and 69d, 
and a sub picture decoder 159 are all synchronized to a 
system time dock given by the AV synchronizatian con- 
trol section in Rgure 30 to process the data in the sys- 
tem stream. 

[0188] Regarding a first method, the AV synchroniza- 
tion control section 1 58 will be described with reference 
to Figure 30. 

[0189] In Figure 30, the AV synchronization control 



section includes STC switches 162a. 162b. 162c and 
162d. an STC 163, an STC offset synthesis section 
164, an STC setting section 165 and an STC switch tim- 
ing control section 166. 

[01 90] The STC switches 1 62a. 1 62b, 1 62c, 1 62d and 
162e switch between an output value of the STC 163 
and an output value of the STC offset value synthesis 
section 164 as a reference clock to be provided to the 
system decoder 161, the audio decoder 160, the main 
video decoder 69c. the sub video decoder 69d and the 
sub picture decoder 159. respectively 
[01 91 ] The STC 1 63 is a reference clock of the entire 
MPEG decoder shown in Figure 39 in ordinary repro- 
duction. 

[0192] The STC offset synthesis section 164 contin- 
ues outputting a value ok)tained by subtracting the STC 
offset value provided by the system control section from 
the value of the STC 163. 

[01 93] The STC setting section 1 65 sets an STC initial 
value given by the system conti'ol section or an STC off- 
set synthesis value given by tiie STC offset synthesis 
section 164 in tiie STC 163 at tiie timing given by the 
STC switch timing control section 166. 
[01 94] The STC switch timing control section 1 66 con- 
ti-ols the STC switches 1 62a through 162e and the STC 
setting section 165 based on STC switch timing infor- 
mation given by the system control section, the STC 
163. and the STC offset synthesis value given by the 
STC offset synthesis sectton 164. 
[01 95] The STC offset value is an offset value used for 
changing the STC value when system sti'eam #1 and 
system stream 02 having different STC initial values are 
continuously reproduced. 

[01 96] The STC offset value is specifically obtained by 
subtracting the "VOB reproduction start time 
(VOB_S_PTM)" described in the DSI of system stream 
#2 to be reproduced next from the "VOB reproduction 
end time {VOB.E.PTM}" described in the DSI of sys- 
tem stream #1 reproduced first. The infbrmation regard- 
ing the display of such a value is pre-c^culated by 
reading data from the optical disk in Figure 5 by the sys- 
tem confrol section 167 when the data is input to the 
track buffer 23. 

[01 97] The calculated offset value is supplied to the 
STC offset synthesis section 164 before the last pack of 
system sfream #1 is input to the system decoder 161 . 
[0198] Except for seamless connection control, the 
data decoding processing section 165 in Rgure 5 oper- 
ates as an MPEG decoder. The STC offset value given 
by tiie system control section 21 is 0 or an arbitrary 
value. The STC witches 162a ttirough 162e always is 
selected to be connected to the STC 1 63. 
[0199] Wrth reference to Figure 38, switching of the 
STC switches 162a tiirough 1 62e in tiie connection part 
of the system control section and an operation of tiie 
STC 163 when two system streams having non-contin- 
uous STC values, such as system streams #1 and #2, 
are continuously input to the system decoder 1 61 will be 
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described. 

[0200] The SCR. APTS. VPTS and VDTS of the sys- 
tem streams #1 and #2 to be input will not be described. 
[0201] In the SIC 163, an initial STC value conre- 
spending to system stream #1 which is being repro- s 
duced is set by the STC setting section 165, and the 
value is sequentially counted up in accordance with the 
reproduction. The system control section 167 (Figure 5} 
calculates the STC offset value by the above<lescribed 
method and sets this value in the STC offset synthesis 
section 1 64 before the last pack of system stream #1 is 
input to the decoder buffer. The STC offset synthesis 
section 164 continues outputting a value obtained by 
subtracting the STC offset value from the value of the 
STC offset 163. 

[0202] The STC switch timing control section 166 
obtains time T1 , at which the last pack of system stream 
#1 reproduced first is input to the decoder buffer, and 
switches the STC switch 1 62a to the output side of the 
STC offset synthesis section 164 at time T1 (step 
168b). 

[0203] Thereafter, the STC value referred to by the 
system decoder 161 is provided with an output from the 
STC offset synthesis section 164. The transfer timing of 
system stream #2 to the system decoder 161 is deter- 
mined by the SCR described in the pack header of sys- 
tem stream #2. 

[0204] Next the STC switch timing section 166 
obtains time T2, at whteh the reproduction of the last 
audio frame of system stream #2 is terminated, and 
switches the STC switch 162b to the output side of the 
STC offset synthesis section 1 64 at time T2 (step 1 68c} 
at time T2. A method for obtaining time T2 will be 
described later. 

[0205] Thereafter, the STC value referred to by the 
audio decoder 160 is provided with an output from the 
STC offset synthesis section 164. The output timing of 
system stream #2 is determined by the APTS described 
in the audio packet of system stream #2. 
[0206] Next the STC switch timing section 166 
obtains time T3 and T3', at which the decoding of the 
last video frame of the main signal and the sub signal of 
system stream #1 reproduced first is terminated, and 
switches the STC switches 1 62c and 162d to the output 
side of the STC offset synthesis section 164 at time T3 
and T3' (step 168d). A method for obtaining time T3 will 
be described later. Thereafter, the STC value refen^ed to 
by the video decoders 69c and 69d is provided with an 
output from the STC offset synthesis section 164. The 
video decoding timing of system stream #2 is deter- 
mined by the VPTS described in the video packet of 
system stream #2. Next, the STC switch timing section 
1 66 obtains time T4, at which the reproduction output of 
the last video frame of system stream #1 reproduced 
first is terminated, and switches the STC switch 1 62e to 
the output side of the STC offset synthesis section 164 
at time T4 (step 168e). A method for obtaining time T4 
will be described later. 



[0207] Thereafter, the STC value referred to by the 
video output switch 169 and the sub picture decoder 
159 is provided with an output from the STC offset syn- 
thesis section 1 64. The video output timing and sub pic- 
ture output timing of system stream #2 are determined 
by the VPTS and SPTS described in the video packet 
and the sub picture packet of system stream #2. 
[0208] When switching of the STC switches 162a 
through 1 62e is completed, the STC setting section 165 
sets the value given by the STC offset synthesis section 
164 in the STC 163 (step 168f) (refered to as "reload- 
ing of the STC 163) and switches all the switches 162a 
through 162e to be connected to the STC 163 (step 
168fl). 

[0209] Thereafter, the STC value referred to by the 
audio decoder 160. the video decoders 69c and 69d. 
the video output switch 169 and the sub picture decoder 
159 is provided with an output from the STC 163, and 
the operation returns to the ordinary operation. 
[021 0] Now, two means for obtaining time T1 through 
T4 for switching the STC will be described. 
[P211] According to first means, information repre- 
senting time T1 through T4, which can be easily calcu- 
lated when the streams are created, is recorded on the 
disk. The system control section 21 reads the informa- 
tion and sends the information to the STC switch timing 
control section 166. 

[021 2] Especially as T4, "VOB reproduction end time 
(VOB_E_PTM)" described in the DSI is used as it is. 
[021 3] On the disk, the value obtained based on the 
STC value used in system stream #1 reproduced first is 
described, and the STC switch timing control section 
166 switches the STC switches 162a through 162e at 
the moment the value of the STC 1 63 becomes time T1 
through T4. 

[021 4] According to second means, based on the tim- 
ing when the leading data of system stream #1 is written 
in the track buffer 23. the video decoder buffers 1 71 and 
171a. and the audio decoder buffer 172, the time for 
reading the leading data is obtained. 
[0215] Assuming that the track buffer 23 is a ring 
buffer including a writing pointer, a reading pointer and 
a data menix>ry, the system control section 21 specifi- 
cally reads an address indtoated by the writing pointer 
and an address indicated by the reading pointer. Based 
on an address indicated by the writing pointer and an 
address indicated by the reading pointer when a target 
pack is written, the system control section 21 detects 
the nK)ment when the pack written immediately before 
is read. 

[0216] When reproduction of system stream #1 is 
completed and reproduction of system stream #2 is 
started, the system control section 21 indicates the 
leading address of system stream #2 on the optical disk 
for reading. Accordingly, the system control section 21 
learns the moment when the leading data of system 
stream #2 is stored in the track buffer 23. Next, time T1 
is obtained by marking the address where the leading 
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pack of system stream #2 is written and setting the 
rTX}ment when reading of the immediately previOLS pack 
is completed as 11. 

[021 7] The moment 11 is obtained, the system control 
section 21 informs T1 to the video decoders 69c and s 
69d and the audio decoder 1 60. Thus, the video decod- 
ers 69c and 69d and the audio decoder 160 learn that 
the leading packet of system stream #2 will be trans- 
ferred to the video buffer 171 and the audio buffer 172 
thereafter. 

[0218] Accordingly, the two video decoders 69c and 
69d and the audio decoder 160 learn the moment when 
the last packet of system stream #1 is transferred and 
obtain T2 and T3 1]^ managing each decoder buffer in 
the same manner as the buffer management of the track 
buffer 23. 

[0219] In the case where T1 is detected, all the data 
has been read from the video decoder buffer 171 or 
audio decoder buffer 172 (immediately after the last 
frame of system stream #1 is decoded), and no data to 
be written has arrived (when the transfer time period 
between packs is empty), there is no data to be written. 
TTius, address management is Impossible. Even in this 
case, the packet of the frame to be decoded next before 
then next decoding timing (decoding timing of the lead- 
ing frame of system stream #2) is transferred without 
fail. Accordingly, the switch timing Is learned by setting 
the moment of transfer of the packet as T2 or T3. 
[0220] Regarding T4, as described above, "display 
end time of last frame of the video of system stream #1 
(VOB_E_PTM)" can be used as it is. 
[0221] Next, a second method for seamless reproduc- 
tion will be described. 

[0222] Figure 31 shows at wNch timing the system 
stream is reproduced and output after being input to the 
data decoding processing section in Figure 38, passed 
through the decoder buffer and decoded. Wrth refer- 
ence to Rgure 31 , a change in each of APTS and VPTS 
values at the connection point of system streams #1 
and #2 will be described, and a method for AV synchro- 
nization control at the seamless connection area during 
the actual stream processing will be described. 
[0223] Then, with reference to the graph in Figure 31 . 
a metfiod for performing seamless connection control in 
accordance with the process represented by the fkiw- 
chart In Figure 43 wit) be descried. 
[0224] TTie starting timing of the seamless connection 
control Is as shown In part (3) of Figure 31 regarding 
SCR. While the SCR value In the graph Is increasing, 
system stream #1 is transfen^ed from the track buffer 23 
(Rgure 5) to the data decoding processing section 16 
(Figure 5). Only at point Q when the transfer of system 
stream #1 Is completed and transfer of system stream 
#2 is started, the SCR value Is "0". Accordingly, it Is 
found that new system stream #2 is input to the data 
decoding processing section 16 by finding point Q at 
which the SCR value is "0". At this point (time Tg), the 
synchronization mechanism control section can turn off 



(release) the AV synchronization mechanism of the 
reproduction output section. 
[0225] It can be detected that the SCR value is "0" 
after the signal read from the optical disk is processed 
or written into the track buffer 23. The AV synchroniza- 
tion mechanism can be turned off based on the detec- 
tion at this point. 

[0226] In order to determine the timing at which AV 
synchronization mechanism once turned off should be 
turned on (started) again, it is necessary to know that 
both the audio output and the video output included In 
system stream #1 have changed to the audio output 
and the video output of new system stream #2 to pre- 
vent inconsistent reproduction by which the audio and 
video signals do not match. The moment the audio out- 
put of the previous system stream is changed to the 
audio output, new system stream #2 can be found by 
detecting point H at which the APTS value stops 
increasing. The moment the video output of the previ- 
ous system stream is changed to the video output, new 
system stream #2 can be found by detecting point I at 
v^iich the VPTS value stops increasing. Accordingly, 
the synchronization mechanism control section can 
restart the AV synchronizatkin at time T1, i.e.. Immedi- 
ately after finding that point H and point I both appear. 
[0227] When the SCR value is not set in the SCR or 
the APTS value and VPTS value are directly compared 
with each other during the period from time Tg to time 
Tl, the period in which the AV synchronization mecha- 
nism is off can be further shortened. 
[0228] In order to realize this, both the APTS value of 
the audio output data and the VPTS value of the video 
output data from the data decocfing processing section 
16 are nxxiitored, and the value which becomes lower 
first is detected. At this point, i.e.. time Th in Rgure 31, 
the AV synchronisation mechanism is turned off. 
[P229] As is apparent, In order to perform the timing 
determinatbn based on whether the APTS and VPTS 
values continue increasing, the APTS and VPTS values 
need to be reduced at the point where the system 
streams are connected. In other words, the last APTS 
and VPTS values in the system stream need to k>e 
larger than the maximum initial values of APTS and 
VPTS in the system stream. 

[0230] The initial APTS and VPTS values (ATad, ATvd 
in the figure) are determined as follows. 
[0231 ] The initial APTS and VPTS values are each a 
sum of the time period in which vkJeo data or audio data 
IS stored in the video buffer or audio buffer and the reor- 
6& of the video (in MPEG pictures, the decoding order 
and the display order of the pictures do not necessarily 
match, and display can be delayed by one picture at the 
maximum with respect to the decoding). Accordingly, 
the sum of the time period required for the video buffer 
or audio buffer to become full and the display delay (one 
frame) is the maximum Initial value of APTS or VPTS. 
(p232] The system stream can be created so that the 
last APTS and VPTS values In the system stream 
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exceed such values. 

(0233] In this example, the timing for turning on the AV 
synchronization mechanism after the system streams 
are connected has been described to be determined 
based on whether or not the APIS and VPTS values s 
increase. The timing for turning on the AV synchroniza- 
tion mechanism can be determined using the threshold 
value as described below. Rrst. audio and video thresh- 
old values shown In parts (4) and (5) of Rgure 31 are 
determined by the reproduction apparatus. These vai- io 
ues equal to the maximum initial values of ARTS and 
VPTS described above. 

[0234] The timing Is determined based on whether or 
not the ARTS and VPTS values read by the ARTS read- 
ing means and VPTS reading means are respectively is 
below the audio threshold value and video threshold 
value. When the APTS and VPTS values are larger than 
the audio and video threshold values, data has not been 
changed to the data of the new system stream. When 
the APTS and VPTS values are equal to or smaller than 20 
the audio and video threshold values, data output of the 
new system stream has been started. Thus, the timing 
fa turning on and off the AV synchronization mecha- 
nism may be found. 

[0235] The above-described on/off control of the AV 
synchronization mechanism provides seamless repro- 
duction which is not disturbed at the connection area of 
the system streams. 

(Calculation of the synthesis section) 

[0236] Rgure 98 illustrates in detail the calculation of 
the synthesis section of the reproduction apparatus 
shown in Rgure 21 and the division calculation of the 
recording apparatus shown in Rgure 23. 
[0237] Part (a) of Figure 98 illustrates Figure 23 in 
detail. Regarding the 525P or other progressive signal, 
a qth line data 283 represented by A and a (q+1)th line 
data 284 represented by B are subjected to the calcula- 
tion of (A+B}+2 by a first division calculation section 141 
of a division calculation section 285, thereby obtaining a 
low frequency component M. which is set as the qth line 
data of the first stream. In the case of an interlace sig- 
nal, lines 1 , 3 and 5 are created in the p*th field. In the 
(P+1)th field, the (q+1)th line data, i.e., lines 2, 4 and 8 
are calculated on a line-by-line basis. The resultant 
interlace signal is encoded by a first encoder 82a. 
[0238] A second division calculation section 1 43 per- 
forms the calculation of A-B. The DVD format and the 
like do not define a negative value, tn order to realize 
compatibility with the conventional formats. (A-B)^2 is 
added to a constant 257 so that a negative value is not 
obtained. In the case of 8-blt data. 128 is added as the 
constant 277. As a result of the calculation, an interlace 
signal is created as the qlh line data 280 (S). The inter- 
lace signal is encoded by a second encoder 28b and 
recorded on the disk by the MADM interleave system. 
[0239] With reference to part (b) of Rgure 98. a calcu- 



lation of the synthesis section of the reproduction appa- 
ratus shown in Figure 21 will be described in detail. As 
shown in part (a) of Figure 98. the data multiplexed by 
the MADM system according to the present invention 
and recorded on the disk 85 is divided into a first stream 
and a second stream, and processed with decoders 88a 
and 88b to obtain two video signals. This signal is an 
interlace signal and a top line first signal (hereinafter, 
referred to as "TP) in which the top line is an odd line. 
In the synthesis section 90. the calculation of (2M+2S- 
constant)-!-2 is performed by the first catoulation section 
250, where M is the q'th line data of the master signal 
and S is the qth line data of the sub signal. As a result, 
(A+B+A-B+256-256)42»A. The qlh line data (A) Is 
obtained and is output as rlh line data 281 (output pic- 
ture). 

[0240] As shown in part (a) of Rgure 98, the constant 
277 is added by the second calculation sectfon 143. 
Accordingly, the original data is obtained by subtracting 
the twice the value of the value (128) obtained by syn- 
thesis, i.e.. 256. Due to the compatibility, a conventional 
decoder in which negative values are not defined can be 
used. 

[0241 ] Then, the cak;ulation of (2M-2S4<2xconstant)) 
is performed by a second calculation section 251 . As a 
result. (A+B-A-B-256-256)^2=B. The (q+1)th line data 
284 is obtained and output as (r-i-l)th line data 282. 
[0242] Thus, two interlace signals are synthesized, 
and a progressive video signal having 480 lines (1st 
through 480tii lines) Is output 
[0243] The system shown in Figures 98. 21 and 23 
has a feature that division and synthesis can be con- 
ducted with only one adder and one subtracter for 8-bit 
data and 1 0-bit data and thus the circuit structure is sim- 
plified. Thus, a high resolution picture with progressive 
and wide vkleo signals are obtained with no significant 
cost increase. 

[0244] Since a negative value is reproduced simply by 
adding the constants 278a and 278b to the A-B signal, 
tiie conventional decoders 279 and 280 whk^h cannot 
handle negative values are usable. 
[0245] As shown in part (a) of Figure 98, in botii the 
first stream and the second stream, the first line of the 
first field Is an odd line (Top Line Rrst; TP). According an 
encoder of the DVD format, fields are dropped unless 
the streams are Top Line First streams. Since each 
stream Is a Top Line First sta'eam according to the sys- 
tem of the present invention, fields are not dropped. 
[0246] Figure 96 shows an overall operation of the 
reproduction apparatus shown in part (b) of Figure 98. A 
reproduction signal is divided by a division section 87 in 
units of nGOP into a first stream and a second stream. 
The first and second streams are decoded by first and 
second decoders 88a and 88b into two Top Line Rrst 
(TF) streams. A Top Line First signal 244 and a Bottom 
Line First signal 245 are created by the first calculation 
section 250 and the second calculation section 251. 
Then, an analog signal such as 525R is output by a DA 
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convers'ton section 266. 

[0247] In Figure 96, two field pictures having the same 
time stamp are synthesized in a vertical direction. By 
synthesizing the pictures in a horizontal direction 
according to the present invention, the horizontal reso- 
lution can be doubled. Figures 58, 59 and 60 show a 
recording apparatus, and Figure 20 shows a reproduc- 
tion apparatus including a wide picture synthesis sec- 
tion 173. With reference to Figures 91 and 92, the 
principle of the division section of the recording appara- 
tus and the principle of the wide picture synthesis sec- 
tion 1 73 of the reproduction apparatus will be described 
in detail. 

[0248] Figure 91 shows a method fbr dividing a lumi- 
nance signal and a color signal in the left half. Lumi- 
nance signals YD and Y1 of input pixel signals 287a and 
287b having a 1440 pixels in the horizontal direction are 
subjected to addition and subtraction respectively by a 
first division calculation section 141a and a second divi- 
sion calculation section 141b shown in Figures 91 and 
92 of the division calculation section 285 in Figure 98. 
Thus, a luminance signal of (Y0+Y1)/2 of the first 
stream and a luminance signal of (Y0-Y1)/2 of the sec- 
ond stream are generated. TTie input signal having 1 440 
pixels in the horizontal direction is divided into two video 
signals each having 720 pixels in the horizontal direc- 
tion. The first stream is passed through a horizontal filter 
and thus deprived of a high frequency component 
Accordingly, even when only the first stream is output on 
the saeen by the conventional apparatus, aliasing dis- 
tortion does not occur. Thus, compatibility with the con- 
ventional apparatus Is obtained. Rgure 92 shows 
processing of a color signal. An input pixe) signal 287a 
and an input pixel signal 287c with one input pixel signal 
interposed therebetween are used. From a signal CbO 
of input pixel signal 287a and a signal Cb2 of the input 
pixel signal 287c. a sum signal (CbOfCb2)/2 is obtained 
and set as a division pixel signal 290a of the first 
stream. A difference signal (Cb0-Cb2)/2 is set as a divi- 
sion pixel signal 291a of the second stream. In a similar 
manner. (CtOf Cr2)/2 and (CtO-CrZ)/2 are obtained from 
input pixel signals 287b and 287d. From these signals, 
division pixel signals 290b and 291 b of the first and sec- 
ond streams are obtained. Thus, a high resolution sig- 
nal having 1440 pixel in the horizontal direction is 
divided into two NTSC-grade digital video signals of the 
CCIR601 and SMPTE295M formats. 
[0249] Next, the processing of the synthesis section 
173 of the reproduction apparatus briefly described with 
reference to Figure 20 will be described in detail. In the 
synthesis section 90 in Figure 91, division pixel signals 
288b and 289b of the first and second streams are 
added together by the first calculation section 250 by 
the calculation of (Y6+Y7)y2+(X-Y+256)/2-128^Y6. 
Thus, the input pixel 287g is obtained. Next, the differ- 
ence calculation of (Y6+Y7)/24(X6-Y7+256)/2+128=Y7 
is performed. Thus, the luminance signal of the input 
pixel 287T1 is obtained. In this manner, a high resolution 



signal having 1440 pixels in the horizontal direction is 
obtained from two signals each having 720 pixels in the 
horizontal direction by a sum calculation and a differ- 
ence calculation. 

5 [0250] Next, synthesis calculation of color signals will 
be described with reference to Figure 92. In the case of 
the Cr signal, the division pixel signals 290d arKi 291 d 
of the first and second streams are subjected to sum 
calculation by the first calculation section 250 and differ- 

10 ence calculation by the second calculation section 251 . 
Specifically, the calculations of (Cr4+Cr6)/2+{Cr4- 
Cre+256)/2-128=Cr4 and (Cr4+Cr6)/2-{Cr4- 
Cr6+256}/2-i-128sCr6 are performed. Cr4 and Cr6 are 
obtained and assigned to input pixel signals 287r and 

15 287h. 

[0251 ] Regarding the Cb signals, similar calculations 
are conducted on the division pixel signals 290c and 
291c. Cr4 and Cr6 are obtained and assigned to input 
pixel signals 287e and 287g. Thus, the luminance sig- 

20 nals and color signals of the input signal are completely 
synthesized to obtain a high resolution signal having 
1440 pixel in the horizontal direction. 
[0252] By the 2X reproduction apparatus, an interlace 
signal having 1440 pixels in the horizontal direction is 

25 Obtained. By the reproduction apparatus shown in Fig- 
ure 62, 3-2 transform is performed. In the case where a 
24-frames/sec. signal of a movie or the like is recorded, 
the 24-frames/sec. signal is output a plurality of times by 
the frame memory by the 3-2 transform section 174. 

30 Thus, a 60-frames/sec. progressive video signal is 
obtained. By doubling the horizontal resolution to 1440 
pixels, a wide 525P picture is obtained. Thus, a 
1440x480P progressive picture is output 
[0253] Thus, by combining the 3-2 transform section 

35 174 and the wide picture synthesis section 173, a 
1440x480P high resolution progressive picture is output 
from a 24P picture such as a movie even by the 2X 
reproduction apparatus. When such a picture is repro- 
duced by an existng DVD player, only the sum signal of 

40 the first stream is reproduced, but horizontal interlace 
interference does not occur since the picture is horizon- 
tally filtered. 

[0254] With reference to Figure 97. an operation of 
reproducing data on an MADM disk will be described. 

46 On the MADM disk, a 60-frames/sec. progressive pic- 
ture is divided into two frames, i.e., an odd frame 294 
and an even frame 295. The operation of the division 
section 87 and the decoding section 88 is the same as 
described with reference to Rgure 96 and will not be 

so described. In the time direction synthesis section 296, a 
first field 297a and a second field 297b of the first 
stream are synthesized into a first odd frame 294a. A 
first field 298a and a second f iekJ 298b of the second 
stream are synthesized into a first even frame 295a. 

55 These frames are synthesized in the time direction in 
the order of the first odd frame 294a. thef irst even frame 
295a. the first odd frame 294b. and the second even 
frame 295b every 1/60 second. Thus, a 60-frames/!Bec. 
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progressive picture is reproduced. By the existing IX 
reproduction apparatus, only tiie first stream is repro- 
duced; i.e., a 525P interlace signal is reproduced and 
the compatibility Is realized. However, the motion is 
slightly unnatural since the picture is a 30-frames/sec. s 
picture. This system is an MADM system for recording 
two 30-frames/sec. streanre and has the effect of a high 
encoding efficiency of the MPEG encoder due to the 
progressive picture. 

10 

(Optimization of buffer amount) 

[0255] Regarding the total capacity of the track buffer 
circuit 23 in Figure 5. it was described that data for at 
least one interleave block needs to be accommodated is 
in the track buffer circuit 23 in order to reproduce two 
streams simuKaneously as shown in Figure 45. With ref- 
erence to Figure 87, a buffer amount required for the 
MADM system reproduction according to the present 
invention will be calculated. As the capacity of one inter- 20 
leave block, the values in Figure 87 are obtained by caJ- 
culation. Figure 87 shows interleave unit lengths 
required for 5000-sector and 10000-sector track jumps 
with respect to each of transfer rates. The maximum 
transfer rate is 8 Mbps, and the maximum jump length is 25 
10000 sectors. With the minimum of 551 sectors as the 
interleave unit length, a stable track jump is realized for 
switching to an interleave unit of another stream even by 
a IX drive. In actuality, a drive of more than IX is used, 
and thus the length of 551 sectors is not necessary. In 30 
consideration of the worst case, the disk manufacturers 
record an interleave unit of 551 or mae sectors for an 8 
Mbps stream. Accordingly a buffer memory for one 
interleave unit is required by the MADM system accord- 
ing to the present invention as shown in Rgure 45. Sta- 3S 
ble simultaneous reproduction of two streams is 
realized by setting a buffer memory of 551 sectors or 
more and 1 102 bytes or more. 

(Switching between two pieces of reproduction infbrma- 40 
tion) 

[0256] Figures 93, 94 and 95 illustrate a system for 
maintaining the conpatibility by reproducing the same 
disk by a conventionai apparatus and an apparatus 4S 
according to the present invention. 
[0257] Figure 95 shows an operation of the conven- 
tional apparatus for reproducing an MADM system disk 
according to the present invention in part (a), and shows 
an operation of an MADM system apparatus for repro- so 
ducing the MADM system disk in part (b). 
[0258] An optical disk la includes a plurality of (four in 
the figure) streams recorded in a divided manner 
Accordingly, four interleave units 84a, 84b, 84c and 84d 
having the same information on an n time period are 55 
recorded on the optical disk la in an order. Also on the 
optical disk la. a second reproduction infbrmation iden- 
tifier 302 is recorded. The second reproductton informa- 



tion identifier 301 indicates that first reproduction 
information 300 for reproducing streams 1 and 3 and 
second reproduction information 301 for reproducing 
streams 2 and 4 are recorded on the optical disk la. 
[0259] As shown in part (c) of Figure 95. the first 
reproduction information 300. 300a and 300c has only 
leading address information regarding the interleave 
blocks 84a and 84c con-esponding to streams 1 and 3. 
i.e., a pointer. The second reproduction information 
identifier 302 is not reproduced by an existing reproduc- 
tion apparatus which does not consider reproduction of 
MADM data. Thus, the second reproduction information 
identifier 301 cannot be read or utilized effectively. 
Accordingly, the conventtonal apparatus operates as if 
only streams 1 and 3 are recorded. Streams 2 and 4 are 
not reproduced at all. A conventional reproduction 
apparatus reproduces, for example, only the left-eye 
information from an optical disk having a 3D signal 
recorded in an MADM system. When 3D display is not 
conducted, display of a meaningless right-eye picture is 
prevented. 

[0260] In the case of an optical disk having a high def- 
inition picture recorded in an MADM system, streams 1 
and 3 have basic components, for example, NTSC. 
Streams 2 and 4 have a differential signal, i.e., colorless 
line-drawing. Since streams 2 and 4 are not reproduced 
by the conventional apparatus, it is prevented that the 
user views such an unpleasant picture. When such an 
MADM disk is reproduced by a conventtonal reproduc- 
tion apparatus, a normal picture of streams 1 and 3 is 
reproduced but an abnormal picture of streams 2 and 4 
is not reproduced. Accordingly, complete compatibility is 
realized. This operation will be desaibed with a flow- 
chart. As shown in Figure 93. in step 303a. an MADM 
disk having m streams is reproduced. First reproduction 
information 300a has pointer information on streams 1 
and 3, i.e.. the leading address of the interleave unit 84e 
to be jumped to next. The address information is used to 
conduct a track jump over a plurality of trade as shown 
in Figure 3 to access the leading address of the inter- 
leave block 84e. The interleave block 84e is the first 
btock among the subsequent blocks in stream 1 having 
time information. Thus, data in stream 1 is continuously 
reproduced. 

[0261] When an instruction to switoh the stream is 
issued in step 303b, whether there is an identifier show- 
ing the existence of a PCI table is present or not is 
checked In step 303c. A DVD has a PCI Uentifier (non- 
seamless) showing the existence of the second repro- 
duction information 301 . An MADM disk has a DSI iden- 
tifier (seamless) showing the existence of the first 
reproductton information is recorded in lieu of the PCI 
kJentlfier. When the disk is an MADM disK the process- 
ing advances to step 303d to utilize the DSI table having 
the first reproductions information. The first reproduc- 
tion information has pointer information on only streams 
1 and 3 in step 303e. Therefore, in step 303f, a track 
jump is conducted based on the pointer infbrmation on 
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streams 1 and 3 to maintain the continuous reproduc- 
tion mode of stream 1. Alternatively, stream 1 Is 
switched to stream 3, and reproduction is conducted 
continuously In terms of time but while skipping from 
data to data. As shown in step 303g. an ordinary NTSC 
picture of streams 1 and 3 is reproduced, but an 
unpleasant, unnecessary picture of streams 2 and 4 is 
not output Thus, complete compatibility is realized. 
[0262] A process for simultaneously reproducing two 
streams out of streams 1, 2, 3 and 4 by the MADM 
reproduction apparatus will be described with reference 
to Figures 94 and 95. As shown by second reproduction 
information 301. 301a, 301b, 301c and 301d in part (b) 
of Rgure 95, the interleave unit 84a has leading 
address information of the interleave unit 84e, which is 
the next time information of streams 1 , 2, 3 and 4. Since 
a physical addresses of a sector of an arbitrary inter- 
leave unit 84e, 84f. 84g or 84h Is found, a track jump is 
easily conducted. The reason is that the MADM repro- 
duction apparatus reproduces the second reproduction 
information identifier 302. learns the existence of the 
second reproduction information, and utilizes the sec- 
ond reproduction information 301. 
[0263] Thus, simultaneous reproduction of streams 1 
and 2 or streams 3 and 4 is performed, and reproduc- 
tion of a 3D or high resolution signal from an MADM disk 
is realized. The second reproduction information identi- 
fier 302 only needs to distinguish a conventional disk 
from an MADM disK and can be even 1-bit data. An 
MADM identifier indicating the existence of a high reso- 
lution signal or 3D signal can be used. 
[0264] This operation will be described with reference 
to the flowchart in Figure 94. In step 304a. an MADM 
disk is reproduced. In step 304b. it is checked whether 
there is a second reproduction information identifier 302 
or not, or whether there is an MADM high resolutionySD 
klentif ier or not. If na the disk is determined to be a con- 
ventional disk and the processing goes to step 304h. If 
yes. the processing goes to step 304c to check fbr the 
identifier of the interleave unit 84. H there is an identifier 
showing the existence of the second reproduction infor- 
mation, or if there is a seamless ktentifier in the case of 
the DVD. the seamless kJentifier is interpreted as a non- 
seamless Identifier. The second reproduction informa- 
tion, which is not actually valid, is regarded as being 
valid in step 304d. In step 304e, link information on 
steps 1. 2, 3 and 4 is extracted from the second repro- 
duction information. 

[0265] In step 304f. first reproduction information, or a 
main stream which is switchable from the DSI tabUe in 
the case of the DVD. is detected. In the example shown 
in Rgure 95, streams 1 and 3 are found to be main 
streams. The first reproduction infbrmation includes 
main stream infbrmation. and the second reproduction 
information includes main and sub stream infbrmation. 
Accordingly, the main and sub streams can be distin- 
guished based on the first and second reproduction 
infbrmation. In the case of Rgure 95, the number of 



stream groups (angles) is found to be 2 by checking the 
second reproduction information. 
[0266] When an instruction to switch the stream 
(angles) is issued in step 304g. a switch from stream 1 

5 to stream 3 is conducted in step 304m. For this, simul- 
taneous reproduction mode (A) fbr streams 1 and 2 
using pointer infbrmation on streams 1 and 2 of the sec- 
ond reproduction infbrmation is switched to simultane- 
ous reproduction mode (B) for streams 3 and 4. In other 

10 words, stepping access to the interleave units 84a, 84b, 
84e and 84f is switched to stepping access to the inter- 
leave units 84c. 84d and 84g. Thus, two-stream groups 
can be switched in units of two streams. 
[0267] Returning to step 304h. when a seamless iden- 

15 tifier indicating the second reproduction information is 
invalid is recorded on the disk, the conventional appara- 
tus regards the second reproduction information (PCI) 
as being invalid in step 304J. Thus, only streams 1 and 
3 are reproduced using only the first reproduction infor- 

20 mation (DSI) in step 304k. 

[0268] As described above, by detecting either the 
conventional or the MADM identifier, the second repro- 
duction information which is not valid in accordance with 
the conventional rule is regarded as being valid. Accord- 

25 ingly, a meaningless or unpleasant picture is not output 
from the MADM disk even by a conventional apparatus. 
Thus, the compatibility is improved. 

(2-screen simultaneous reproduction) 

30 

[0269] With reference to Figure 90, an operation of the 
2-screen synthesis section 28 described with reference 
to Figure 5 will be described in detail. Although n pieces 
of saeens are used, the representatton of 2*screen is 

35 used in this specification. To the n-screen synthesis 
section 28b in Rgure 90, a first picture (A) and a second 
picture (B) of the first stream, a first sub picture and a 
second sub picture are input In a simple structure, a 
line memory 28c is included. In this case, line-synthesis 

40 of the first picture (A) 28p and the second picture (B) 
28q results in a picture of mode 1L having two screens 
side by side is obtained. Audk) signals (A) and (B) of the 
first and second streams are synthesized by an audio 
mixer 28f. In the case of mode 1 L. only the audio signal 

45 (A) is output. In mode 2L. a first sub picture of the first 
stream is synthesized on the screen. Only one sub pic- 
ture 28r such as subtitles is selected and displayed by 
the n-screen synthesis sectton 28bL This has an effect 
of enlarging the display. In mode 2L, a second audio sig- 

50 nal B is output after mixing to the speaker to the right of 
the screen. Thus, the second audio signal 28s of the 
second picture B can be listened to at a lew volume. 
[0270] As a higher structure, a firame memory 28d can 
be used. In this case, zooming of two saeens Is real- 

55 ized. A zoom signal generation section 28e which has 
received a zoom instruction signal 28p sends a ratio 
change signal to the n-screen synthesis section 28b 
and the audio mixer 28f. When the first picture (A) is 
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enlarged as shown in the 2-screen picture 281 in mode 
1 , the first audio signal is used. In an opposite case, the 
second audio signal is output as in the 2-screen picture 
28J. Thus, by changing the ratio of the video signals and 
audio signals of the first and second streams, video and 
audio can be matched. Pictures of streams 3 through 6 
can be displayed in a divided manner as shown in a 2- 
screen picture 28m. 

[0271 ] As described above, In the embodiment where 
two streams are simultaneously reproduced to output 
two video signals, and the synthesis of video signals 
and synthesis of audio signals are performed using the 
2-screen synthesis sections 28 and 28b and the audio 
mixer 28f, two streams, fbr example, pictures taken by 
two cameras can be viewed simultaneously. 

(Alteration of the filter) 

[0272] According to the present Invention, a video sig- 
nal is divided into a low frequency component and a 
high frequency component by a picture division section 
141a shown in. for example, Figure 22. The division fil- 
ter can be represented as in Figure 46. In Figure 22. 
division calculation of the first stream is conducted by 
calculation parameters of ml=0, m2=1/2, m3=1/2, and 
m4sO. Division calculation of the second stream is con- 
ducted by calculation parameters of ml^o. m2s1/2, 
m3s-1/2. and m4=0. Under these conditions, a 525P 
progressive signal is divided into a \<m/ frequency com- 
ponent and a high frequency component at the vertical 
resolution of 250. 

[0273] The dividing frequency of the border can be 
aHered by changing the calculation parameters of m1, 
m2, m3 and m4. As shown in Figure SO, the dividing fre- 
quency can be changed from 200, to 250 and to 300, 
and each filter identifier 144 can be recorded on the 
optical disk. Thus, the filter identifier 144 is detected tjy 
a filter identifier reproduction section 305 of the repro- 
duction apparatus in Figure 96 during data reproduc- 
tion, and the set values of calculation parameters of n1 
n2. n3 and n4 of the calculation section 212a are 
changed by a calculation parameter output section 306 
in accordance with the filter Identrfier in Rgure 50. The 
calculation section 21 2a of the synthesis section 90 per- 
forms calculation by the set values and processes verti- 
cal lines n-1. n, n+1 and n+2 based on the calculation 
parameters 196 of n1 . n2, n3 and n4. thereby obtaining 
the n-line signal. This processing can be actually per- 
formed in the first calculation section 250 and the sec- 
ond calculation section 251 . 
[0274] By changing the dividing frequency of the pic- 
ture division filter, the distribution of the data amount 
between the first and second streams can be changed. 
In the case of the DVD format the first and second 
streams each have a maximum capacity of 8 Mpbs. 
When the dividing frequency is fixed, a picture having a 
high ratio of high frequency component causes the sec- 
ond stream data to overflow, resulting in collapse of 



MPEG encoding signal in the high frequency range. A 
picture having a high ratio of low frequency component 
causes the first stream data to overflow, resulting in col- 
lapse of encoding to significantly deteriorating the pic- 

5 ture quality. In the case where the dividing frequency is 
variable, when the high frequency component is exces- 
sive, the dividing frequency in Figure 50 can be 
increased to 300. Thus, the second stream data amount 
is reduced and the first stream data amount is 

10 increased. Thus, the distribution of the data is opti- 
mized, so that the collapse of encoding is avoided. 
[p275] When the low frequency component is exces- 
sive, the dividing frequency can be decreased to 200. 
Thus, the first stream data amount is reduced, which 

15 avoids collapse. Collapse is usually avoided this way. 
and the variable dividing frequency is effective. By 
changing the border of the division filter in accordance 
with the condition of the picture, collapse of encoding of 
one of the streams can be avoided. Accordingly, a satis- 

20 factory video signal is obtained. In other words, the 
overflow of the first or second stream is avoided by 
changing the division point, so that recording and repro- 
duction are performed with the data amount being dis- 
tributed in a satisfactory manner. 

25 

(Scanning line fransform) 

[0276] An operation of a scanning line transform sec- 
tion 29a described with reference to Figure 5 will be 

30 specifically described. An MADM disk includes both an 
area having a high resolution signal such as a progres- 
sive signal and an area having a standard re80tutk)n 
signal such as an NTSC signal. The two streams are 
reproduced simultaneously and independently. The out- 

35 put is changed from progressive to NTSC or from NTSC 
to progressive. When a signal is output from the output 
section 29b with no processing at the point of change, 
the scanning frequency is changed from 31.5 kHz to 
15.7 kHz. Therefore, the deflection frequency of the TV 

40 29c is switched, thus disturbing the picture for a few 
seconds. Even in a TV having a built-in line doubler, the 
picture is disturbed when a progressive picture is 
switched to an NTSC picture. According to the present 
invention, this is avoided by automatically switching the 

45 progressive signal by the output section 29b. In more 
detail, the NTSC picture of the first stream is scanned at 
2X by the scanning transform section 29a using an 
MADM disk identifier 1 0h recorded on the MADM disk 1 
or the progressive signal is output as it is. Since the high 

50 resolution area for reproducing two streams is switched 
to an ordinary resolution area fbr reproducing one 
stream, the output signal is immediately changed. 
Therefore, a progressive signal is continuously input to 
the TV 29c. This system eliminates disturbance from 

55 the TV picture. 
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(Stream switching prohibiting flag) 

[0277] As a method for preventing a differential signal 
of a high resolution signal from being output in an exist- 
ing apparatus, a method for recording a stream switch- s 
ing prohibiting flag will be described. 
[0278] As shown in Figure 86. in step 307a. a stream 
switching prohibiting flag 309 is recorded on a disk 1c. 
In step 307b, stream 1 is set as the initial stream value 
in the management information. 
[0279] When the disk 1 c is set in an existing reproduc- 
tion apparatus, in step 307a, management information 
for angle 1, i.e., stream 1 is read. In step 3077, angle 1 
is reproduced. When an angle switch instnjction is 
issued in step 307g, an angle (stream) switching prohib- 
iting flag is checked in step 307h. In an MADM disk, the 
angle (stream) is not switched since the flag is 
recorded. Accordingly, the output of the differential pic- 
ture Is prevented and the compatibility is maintained. 

(HDTV (1080i) output) 

[0280] A method for creating a 1 0801 picture to be out- 
put to an HDTV will be described. In Figure 20, a wide 
525P picture is displayed as shown in the scope screen 
178. The output is transformed into a progressive signal 
having 1 050 lines by a line doubter. The progressive sig- 
nal is further transformed into an interlace signal having 
1050 lines by an interlace transform section 175b. That 
is, an interlace picture 178b having atx}ut 1080 lines is 
obtained. Thus, output to the HDTV is realized. 

(High definition audio output) 

[0281] In Figure 20, a high definition audio signal is 
reproduced, in the case of linear PCM, a range of 1.5 
Mbps to 4 Mbps is required. In MADM, as shown in Fig- 
ure 88, a basic audio section 312 is recorded in stream 
1 with 380 kbps AC3. and a high definition audfo section 
313 is in stream 3. An audio recording identifier 314 is 
recorded as an MADM identifier. In the reproduction 
apparatus in Rgure 20. when an audio recording identi- 
fier 314 is reproduced by an audfo recording identif ier 
reproduction section 111, an audio signal is separated 
from the stream 2, and a high definition audio signal is 
reproduced by an audio decoder 160a and output as an 
audfo signal in the figure. 

[0282] In the case of DVD, one stream has only a max- 
imum of 8 Mbps. When a high definition audio signal 
which can have a n^imum 4 Ml)ps is recorded into 
stream 1 whk:h already has a basic picture, the basic 
pfoture is restricted to only 4 Mbps and deteriorated in 
terms of qual'rty. Thus, compatibility is not maintained. 
According to the present invention, the audio signal is 
accommodated in streams 2, 3 and 4 as the high defini- 
tion audio signals 313a, 313b and 313c in Figure 88. In 
this manner, the high deftnitfon audio signals can be 
recorded without deteriorating the quality of the basic 



picture. Especially, the data amount of 525P differential 
signal in stream 2 is iy2 to 1/3 of the basic picture, and 
thus stream 2 still has about 4 Mbps. Even when the dif- 
ferential vkJeo signal and the high definition signal are 
recorded in streams 2 and 4 as the high definition audio 
signals 313a and 313b in Figure 88, the high definition 
video and audio signals can be reproduced by a 2X 
reproduction apparatus without deteriorating the differ- 
ential signal. 

(Comparison method of MADM identifier) 

[0283] As shown in Figure 4, an MADM disk has an 
MADM identifier in management information such as a 
TXT file. However, the TXT file may possibly have the 
same data as the MADM identifier in error. When the 
non-MADM disk is reproduced as an MADM disk, mal- 
function occurs and an abnormal picture is synthesized 
and output. In order to avoki such malfunction, authen- 
tification data for comparison is recorded according to 
the present invention. 

[0284] As shown in Figure 1 , an authentif ication data 
generation section 315 is provided. The MADM klenti- 
fier 10b and inherent attribute information 316 of the 
disk (master disk) such as the titie of the disK disk ID, 
disk capacity, and final address value are calculated by 
authentif ication data generation calculation section 316. 
Thus, MADM authentificatfon data 318 is generated. 
The MADM authentrfication data 318 is recorded on the 
optical disk 1 together with the MADM identifier 10b and 
tiie authentification data 318 or progressive/3D 
anrangement informatfon. 

[0285] Then, the optical disk 1 is reproduced by the 
reproduction apparatus in Rgure 5 and compared by an 
MADM identifier comparison section 26a. 
[0286] The operation will be described in detail with 
reference to Figure 9. The MADM identifier comparison 
section 26a reads the MADM identifier 10b. the MADM 
auHientification data 318, and the inherent attribute 
information 316 such as the titie of the disk, disk 
number, capacity, and address from tiie optical disk 1, 
and compares the tiiree types of data by the compari- 
son calculation section 319. Only when it is determined 
that the data is correct by the determination sectfon 320, 
an insti-uction to reproduce the MADM disk by the 
MADM reproduction section 321 Is sem to the conti-ol 
section 21 . Thus, ttie two streams are syntiiesized to 
output a high resolution picture or a 3D picture. When it 
is determined that the data is incorrect by the determi- 
nation section 320, an insto-uction to perform ordinary 
reproduction by an ordinary reproduction section 322 
without MADM reproduction is sent. 
]j02ff7] In tills manner, even when tiie same data as 
tiie MADM identifier 10b is recorded in the TXT file in 
error, the MADM reproduction apparatus performs com- 
parison using tiie comparison data. Accordingly, mal- 
function is prevented. The autiientif ication data and the 
MADM klentifier can be one piece of data, or encrypted 
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data of the MADM identifier and the disk attribution 
information can be recorded. 
{0288] So far. applications of a system for reproducing 
and synthesizing a plurality of streams, i.e.. an MADM 
system according to the present invention have been 
described. Hereinafter. MADM synchronization systems 
will be described. 

(Example 2) 

[0289] The MADM system according to the present 
invention simultaneously reproduction of a plurality of 
streams. Synchronization methods are important. In the 
second through eighth examples, various methods of 
synchronization will be described. The MADM system is 
also applicat^e to recording arxJ reproduction of high 
resolution pictures such as 3D or 525P pictures, which 
will not be described below. 

[0290] As an example, in the second example, an 
operation of a reproduction apparatus for reading data 
from an optical disk having three compression video 
signals to be reproduced simultaneously and extending 
and reproducing the three compression video signals 
simultaneously will be described. 
[0291 ] Figure 66 shows a data structure of the optical 
disk used in the optical disk reproduction apparatus in 
the second example. 

[0292] Video signals A, B and C are MPEQ-oom- 
pressed to obtain compression video streams A. B and 

C. 

[0293] The compression video streams A, 8 and C are 
each packeted in units of 2 kB into packets. A packet 
header of each packet includes a stream ID for indk»t- 
ing which one of the compression video streams A 
through C is stored. When the packet stores a leading 
part of the video frame, the packet header also includes 
VPTS (video presentation time stamp) as video repro- 
duction time infbrmation indicating the time to repro- 
duce the frame. In the second example, an NTSC signal 
is used as the picture signal, and the video frame cyde 
is about 33 msec. 

[0294] On the optical disk, video packets created in 
the above-described manner are grouped into, for 
example, compresston video signals A-1, B-1 and C-1 
each including an appropriate number of packets based 
on the data stored, and nuiltiplexed. 
[0295] Figure 64 is a block diagram of the optical disk 
reproduction apparatus in the second example. 
[0296] In Figure 64, the optical disk reproduction 
apparatus includes an optical disk 501 described atsove, 
an optical pickup 502 for reading data from the optical 
disk 501, signal processing means for performing a 
series of signal processing such as binarization, 
demodulation, and enor correction to the signal read by 
the optical pickup 502, a buffer memory 504 for tempo- 
rarily storing the data output from the signal processing 
means 503, division means 505 for divkling the data 
read from the buffer memory 504 into compression 



video signals, and reference time signal generation 
means 506 for generating a reference time signal 506 
including a counter (not shown) for counting 90 kHz 
clocks. Reference numerals 510, 520 and 530 repre- 

5 sent buffer menwries for temporarily storing the com- 
pression vkJeo signals divided by the division means 
505. Reference numerals 511. 521 and 531 represent 
video decoders for extending and reproducing the com- 
pression video signals. Reference numerals 512. S22 

10 and 532 represent monitors for displaying the video sig- 
nals. 

[0297] Figure 65 shows the stmcture of each of the 

video decoders 51 1 , 521 and 531 . 

IP298] As shown in Figure 65, the vkleo decoder 

15 includes VPTS detection means 601 for detecting a 
VPTS stored in the packet header of the video packet, 
video extension means 602 for MPEG-extending the 
compression video stream, and video reproduction tim- 
ing control section 603 fbr comparing the reference time 

20 signal and the VPTS and skipping or repeating the 
video reproduction on a frame-by-frame basis when the 
comparison result exceeds the threstwid vEdue. 
[0299] The optical disk reproduction apparatus shown 
in Rgure 64 operates in the fdfowing manner. 

25 [0300] The optical pickup is focus-controlled or track- 
ing-controlled by servo means (not shown) to read a 
signal from the optk»l disk 501 and outputs the signal to 
the signal processing means 503. The signal process- 
ing means 503 subjects the signal to a series of 

30 processings including binarization. demodulation, enor 
correction and the like. Then, the signal processing 
means 503 stores the resultant signal in the buffer 
memory 504 as digital data. 
[0301 ] The buffer memory 504 functions so that, even 

35 when the data supply from the optical disk 501 is tempo- 
rarily stopped by, e.g., wait state, data supply to the sub- 
sequent-stage sections is not stopped. 
[P302] The data read from the buffer menrary 504 is 
dtvkJed into compression video signals A through C by 

40 the division means 505 and output. The division means 
identifies which of the compression video signals A 
through C is stored in each packet with the packet ID in 
the packet header of the packeted data, and determines 
the destinatfon based on the identification result. 

45 [0303] The divided compression video signals are 
respectively stored in buffer memories 51 0 through 530. 
[0304] The tMjffer memories 510 through 530 act to 
continuously supply data to the video decoders 511 
through 531. 

50 [0305] The video decoders 51 1 through 531 read data 
from the buffer memories 510 through 530 respectively, 
extend the compressfon signals, and output the signals 
as video signals to the nwnitors 512 through 532 

respectively 

55 [0306] With reference to Figure 65. an operation of the 
video decoders 51 1 through 531 will be desaibed. 
[P307] The compression video signal read from the 
buffer memory is input to the VPTS detection means 
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601 and the video extension means 602. 
[0308] The video extension means 602 MPEG- 
extends the compression video stream and outputs the 
video signal. 

[0309] The VPTS detection means 601 detects the s 
VPTS of the packet header. 

[0310] The video reproduction timing control means 
603 receives the video signal output from the video 
extension means 602, a reference time signal and the 
VPTS output from the VPTS detection means 601 . and 
compares the reference time signal arKi the VPTS. 
When the difference between the two exceeds the 
threshold value, the video reproduction timing is control- 
led so that the difl^ence between the VPTS and the ref- 
erence time signal is equal to or less than the threshold 
value. 

[031 1] In the second example, 33 msec is used as the 
threshold value. The video reproduction timing control 
means 603 performs the following. 

(reference time signal-VPTS)>33 msec.:1 frame is 
skipped. 

(reference time slgnal-VPTS)<-33 msec.:1 frame is 
repeated. 

[0312] In the second example, due to the precision 
error of the aystal osdHator used in the reference time 
signal generation means 506 and the video decoders 
511 through 531, the video decoders 511 and 531 are 
slower and the video decoder 521 is faster in terms of 
extension and reproduction with respect to the refer- 
ence time signal. Unless reproduction timing is cor- 
rected, the reproduced video signals are out of 
synchronization. 

[0313] Rgure 67 is a timing diagram of video repro- 
duction in the second example. Part (a) of Figure 67 
shows the reference time signal with respect to repro- 
duction time t. Part (b) shows the VPTS#A. which is a 
VPTS of the compres8k>n video signal A to be extended 
by the video decoder 51 1 . part (c) shows the VPTS#B. 
which Is a VPTS of the compression video signal B to be 
extended by the video decoder 521 . and part (d) shows 
the VPTS#C, which is a VPTS of the compression video 
signal C to be extended by the video decoder 531 . 
[0314] The video decoder 511 continues extension 
and reproduction of the compression video signal A, 
and the difference between the VPTS#A and the refer- 
ence time signal exceeds 33 msec, as the threshold 
value at T1 . Accordingly, the video reproduction timing 
control means of the video decoder 511 skips one 
frame, which is originally to be reproduced, to correct 
the reproduction timing so that the difference between 
the VPTS#A and the reference time signal is equal to or 
less than the threshold value. 
[0315] The video decoder 521 continues extension 
and reproduction of the compression video signal B. 
and the difference between the VPTS#B and the refer- 
ence time signal exceeds -33 nrsec. as the threshold 



value at T2. Accordingly, the video reproduction timing 
control means of the video decoder 521 reproduces one 
frame in repetition, which has been already reproduced, 
to correct the reproduction timing so that the difference 
between the VPTS#B and the reference time signal is 
equal to or less than the threshold value. 
[0316] Similarly, the video decoder 531 continues 
extension and reproduction of the compression video 
signal C, and the difference between the VPTS#C and 
the reference time signal exceeds 33 msec, as the 
threshokJ value at T3. Accordingly, the video reproduc- 
tion timing control means of the video decoder 531 
skips one frame, which is originally to be reproduced, to 
correct the reproduction timing so that the difference 
between the VPTS#C and the reference time signal is 
equal to or less than the threshold value. 
[0317] As desCTibed above, in the second example, 
when the difference between the reference time signal 
and the VPTS detected by each video decoder exceeds 
the threshold value, the video reproduction timing con- 
trol means of each video decoder performs correction 
so that difference between the reference time signal and 
tiie VPTS does not exceed the threshold value. In this 
manrter, the pictures reproduced by video decoders can 
be synchronized with one another. 

(Example 3) 

[0318] The third example relates to a reproduction 
apparatus for correcting a reference time signal using 
audio reproduction time information indicating the time 
to reproduce the audio signal and synchronizes a plural- 
ity of video signals based on the reference time signal. 
[031 9] Figure 70 shows a data structure of the optical 
disk used in tiie optical disk reproduction apparatus in 
the third example. The optical disk includes compres- 
sion audio data in addition to the data included in the 
optical disk used in the second example. 
[0320] An audio signal is audio-framed in units of 32 
msec, for compression to obtain a compression audio 
stream. The audio stream is packeted in units of 2 kB 
into audio packets and recorded on the optical disk. A 
packet header of each aucBo packet includes a stream 
ID for indicating that the stored data is a compression 
audio stiream. When the packet stores a leading part of 
the audk) frame, the packet header also includes APTS 
(audio presentation time stamp) as audio reproduction 
time information indicating the time to reproduce the 
frame. 

[0321 ] Figure 68 is a block diagram of the reproduc- 
tion apparatus in the third example. 
[0322] Elements 501 flirough 532 are the same as 
those shown in Figure 64 in the second example. 
[0323] Reference numeral 504 represents a buffer 
memory for tenporarily storing the compression audio 
signal. Reference numeral 541 represents audio exten- 
sion means for extending the compression audk) signal. 
Reference numeral 542 represents a speaker for repro- 
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ducing the extended audio signal. 

[0324] Figure 69 shows a structure of the audio 

decoder 541. The audio decoder 541 includes APTS 

detection means 701 for detecting an APTS stored in a 

packet header of the audio packet, and audio extension 

means 702 for extending the compression audio 

stream. 

[0325] An operation of the optical disk reproduction 
apparatus shown in Figure 68 for reproducing the opti- 
cal disk shown in Rgure 70 will be described. 
[0326] The operation until the signal is input to the 
division means 505 is similar to that with the optical disk 
reproduction apparatus In the second exampia 
[0327] The data read from the buffer nnenrary 504 is 
divided into compression video signals A through C and 
a compression audio signal by the division means 505 
and output The division means 505 identifies which of 
the compressk>n video signals A through C and the 
compression audio signal is stored in each packet with 
the packet ID in the packet header of the packeted data, 
and determines the destination based on the identifica- 
tion result. 

[0328] The divided compression video signals and 
compression audio signal are respectively stored in 
buffer memories 510 through 540. 
[0329] The video decoders 51 1 through 531 read data 
from the buffer memories 510 through 530 respectively, 
extend the compression video signals, and output the 
signals as video signals to the monitors 512 through 
532 respectively. The audio decoder 541 reads data 
from the buffer memory 540. extends the compression 
audio signal, and outputs the signal as an audio signal 
through the speaker 542. 

[0330] The operattons of the video decoders 511 
through 531 for extending the compression video sig- 
nals and for correcting the synchronization when the dif- 
ference between the reference time signal and the 
VPTS exceeds the threshold value are the same as in 
the second example. 

[0331] The compression audio signal read from the 
buffer memory 540 is input to the audio decoder 541. 
APTS detection means 701 detects an APTS and out- 
puts. Audto extension means 702 extends the compres- 
sion audk) stream and outputs the audio signal. 
[0332] The VPTS signal output from the audio 
decoder 541 is input to the reference time signal gener- 
ation means 506, and the reference time signal is cor- 
rected by the APTS. 

[0333] In the third example, due to the precision error 
of the crystal oscillator used in the reference time signal 
generation means 506, the video decoders 51 1 through 
531 and the audio decoder 541 . the reference time sig- 
nal is faster in tenms of extension and reproductkm with 
respect to the audk) decoder 541 . The video decoder 
511 is slower and the video decoder 521 is faster in 
terms of extension and reproduction with respect to the 
reference time signal. Unless reproduction timing Is cor- 
rected, the reproduced video signals and audio signal 



are out of synchronization. 

[0334] Figure 71 is a timing diagram of audio repro- 
duction in the third example. Part (a) of Figure 71 shows 
the APTS with respect to reproduction time t. Part (b) 

5 shows the reference time signal. Part (c) shows the 
VPTS#A, at which the compression video signal A to be 
extended by the video decoder 51 1 is to be reproduced, 
and part (d) shows the VPTS#B, at which the compres- 
sion video signal B to be extended by the video decoder 

10 521 is be reproduced. 

[0335] Figure 71 does not show the VPTS#C, at which 
the compression video signal C to be extended by the 
video decoder 531 , but the diagram is almost the same 
as in Figure 67 regarding the second example. 

15 [0336] The reference time signal generation means 
506 is corrected using the APTS at time when the APTS 
shows ta1 and ta2, and the reference time signal is 
reset as tal and ta2 at the respective time. 
[0337] The video decoder 511 continues extension 

20 and reproduction of the compression video signal A, 
and the difference between the VPTS#A and the refer- 
ence time signal exceeds 33 msec, as the threshokf 
value at T4. Accordingly, the vkleo reproduction timing 
control means of the video decoder 51 1 skips one frame 

25 which is originally to be reproduced to correct the repro- 
duction timing so that the difference between the 
VPTS#A and the reference time signal is equal to or 
less than the threshokj value. 
[0338] The video decoder 521 continues extension 

30 and reproduction of the compression video signal B, 
and the difference between the VPTS#B and the refer- 
ence time signal exceeds -33 msec, as the threshoM 
value at T5 and T6. Accordingly, the video reproduction 
timing control means of the video decoder 521 repro- 

35 duces one frame in repetition which has been already 
reproduced to con-ect the reproduction timing so that 
the difference between the VPTS#B and the reference 
time signal is equal to or less than the threshoM value. 
[0339] As described above, in the third example, when 

40 the difference between the reference time signal and 
the VPTS detected by each video decoder exceeds the 
threshold value, the video reproduction timing control 
means of each vkleo decoder performs connection so 
that difference between the reference time signal and 

45 the VPTS does not exceed the threshold value. In this 
manner, the pictures reproduced by video decoders can 
be synchronized with one another. 
[0340] Regarding the difference between the refer- 
ence time signal and the APTS. the APTS is not cor- 
se rected using the reference time signal but the reference 
time signal is corrected using the APTS. Accordingly, 
audio and video signals are synchronized with no 
unnaturalness in the audk) output. 

55 (Example 4) 

[0341] The fourth example relates to a reproduction 
apparatus for connecting the reference time signal using 
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a VPTS detected by one video decoder and synchroniz- 
ing a plurality of video signals based on the reference 
time signal. 

[0342] Rgure 72 Is a block diagram of an optical disk 
reproduction apparatus In the fourth example. s 
[0343] Elements 501 through 532 are the same as 
those in the second example. Reference numeral 551 
represents a video decoder used in the fourth example. 
[0344] The video decoder 551 has a function of out- 
putting the detected VPTS. Rgure 73 shows a structure io 
of the video decoder 551 . 

[0345] The video decoder 551 includes VPTS detec- 
tion means 801 for detecting a VPTS indicating the 
reproduction time of the video signal multiplexed as the 
compression video signal and video extension means is 
802 for extending the compression video stream. 
[0346] In the fourth example, due to the precision error 
of the aystal oscillator used in the reference time signal 
generation means 506 and the video decoders 521 , 531 
and 551 , the reference time signal is faster in terms of 20 
extension and reproduction with respect to the video 
decoder 551 . The video decoder 521 is slower and the 
video decoder 531 is faster in terms of extension and 
reproductton with respect to the reference time signal. 
Unless reproduction timing is con'ected. the reproduced 2s 
video signals are out of synchronization. 
[0347] Rgure 74 is a timing diagram of video output in 
the fourth example. Part (a) of Rgure 74 shows the 
VPTS#A detected by the video decoder 511 with 
respect to reproduction time t. Part (b) shows the refer- 30 
ence time signal. Part (c) shows VPTS#B, at which the 
compression video signal B to be extended by the video 
decoder 521 is to be reproduced, and part (d) shows the 
VPTS#C, at which the compression video signal C to be 
extended by the video decoder 531 is to be reproduced, ss 
[0348] The reference time signal generation means 
506 is corrected using the APTS at time when the APTS 
shows tvl and tv2, and the reference time signal is reset 
as tvl and tv2 at the respective time. 
[0349] The video decoder 521 continues extension 40 
and reproduction of the compression video signal B. 
and the difference between the VPTS#B and the refer- 
ence time signal exceeds 33 msec, as the threshold 
value at T7. Accordingly, the video reproduction timing 
control means of the video decoder 521 skips one frame 45 
which is originally to be reproduced to conrect the repro- 
duction timing so that the difference between the 
VPTS#B and the reference time signal is equal to or 
less than the threshokJ value. 

[0350] Similarly, the video decoder 531 continues so 
extension and reproduction of the compression video 
signal C. and the difference between the VPTS#C and 
the reference time signal exceeds 33 msec, as the 
threshold value at TB. Accordingly, the video reproduc- 
tion timing control means of the video decoder 531 55 
reproduces one frame in repetition which has been 
already reproduced to correct the reproduction timing 
so that the difference between the VPTS#C and the ref- 



erence time signal is equal to or less than the ttireshoM 

value. 

[0351] As described above, in the fourth example, 
when the difference between the reference time signal 
and the values of VPTSs detected by the video decod- 
ers 521 and 531 exceeds the threshold value, the video 
reproduction timing control means of each video 
decoder performs correction so that the difference 
between the reference time signal and the VPTS does 
not exceed the threshold value. 
[0352] By connecting the reference time signal using 
the VPTS#A detected by tiie video decoder 551. the 
video signal reproduced by the video decoder 551 is not 
accompanied by any unnaturalness in the visual output 
due to the frame-by-frame skipping or repeated repro- 
duction. Thus, the pictures can be synchronized witti 
one another. 

(Example 5) 

[0353] The fiftii example relates to a reproduction 
apparatus including a plurality of video decoders for 
extending and reproducing a compression video signal. 
Each of the video decoders includes reference time sig- 
nal generation means. TTie reproduction apparatus cor- 
rects the reference time signal of each vkJeo decoder 
using an APTS Indicating the time to reproduce an 
audio signal to realize synchronization. 
[0354] In the fifth example, the optical disk shown in 
Figure 70 is used. 

[0355] Figure 75 is a block diagram of an optical disk 
reproduction apparatus in the fifth exampla 
[0356] Elements 501 tiirough 542 are the same as 
those shown in Rgure 68 in tiie third example. Unlike 
the reproduction apparatijs shown in Rgure 68, the 
reproduction apparatus in this exarrple does not have 
reference time signal generation means 506 independ- 
enUy. but each vkJeo decoder has reference time signal 
generation means. 

[0357] Reference numeral 561 represents a video 
decoder fOr extending and reproducing compression 
video signal A, reference numeral 571 represents a 
video decoder for extending and reproducing compres- 
sion video signal B, and reference numeral 581 repre- 
sents a video decoder fOr exterxling and reproducing 
compression video signal C. 
[0358] Figure 76 shows a structure of each of the 
video decoders 561 through 581 used in the fifth exam- 
ple. 

[0359] The video decoder includes VPTS detection 
means 901 for detecting a VPTS indicating the repro- 
duction time of the video signal multiplexed as the com- 
pression video signal, vkieo extension means 902 for 
extending the conpression video stream, and video 
reproduction timing control means 903 for comparing 
the reference time signal and the VPTS and skipping or 
repeating the video reproduction on a frame-tiy-frame 
basis when the comparison result exceeds the thresh- 
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old value, and reference time signal generation means 
904 for generating the reference time signal. 
[0360] In the fifth example, the reference time signal 
of reference time signal generation means 904 included 
In each of the video decoders 561 through 581 is cor- s 
rected using the APIS detected by the video decoder 
541. 

[0361 ] Since the reference time signals are corrected 
using the same APTS, the reference time signals gener- 
ated in the video decoders 561 through 581 show the 
same value after being corrected. 
[0362] After the correction using the APTS, as in the 
third example, when the difference between the refer- 
ence time signal and the values of VPTS detected by 
each video decoder exceeds the threshold value, the 
video reproduction timing control means of each video 
decoder performs correction by skipping or repeating 
the reproduction on a frame-by-frame basis so that dif- 
ference between the reference time signal and the 
VPTS does not exceed the threshold value. 
[0363] As described above, in the fifth example, the 
reference time signal generated in each video decoder 
Is con'ected with an APTS. and the video reproduction 
timing control means of each video decoder maintains 
the difference between each reference time signal and 
each VPTS to be equal to or less than the threshold 
valua Thus, the pictures can be synchronized with one 
another. 

[0364] As in the third example, the audio signal and 
the video signal can be synchronized without providing 
any inconvenience in the audio output. 
[036^ In the fifth example, the reference time signals 
in the video decoders 561 through 581 are corrected 
using the APTS detected by the audio decoder 541 . TTie 
pictures can be reproduced in synchronization in a sim- 
ilar manner by using one of the video decoders shown 
in Rgure 73 In the fourth example and correcting the ref- 
erence time signals of the other video decoders using 
the VPTS detected by the one video decoder. 

(Example 6) 

[0366] The sixth example relates to a reproduction 
apparatus for simultaneously reproducing two compres- 
sion video signals. The two compression video signals 
are obtained by dividing a signal into a right-eye video 
signal and a left-eye video signal and compressing the 
divided video signals 

[0367] The overall stmcture of the apparatus is gener- 
ally similar to that of the optical disk reproduction appa- 
ratus shown in Figure 75 in the fifth example, but the 
reproduction apparatus in the sixth example includes 
two video decoders for extending compression video 
signals obtained after the division means 505 since two 
video signals are to be reproduced simultaneously. Fig- 
ure 77 shows a structure of one of the video decoders 
used in the sixth exarnple, and Figure 78 shows a struc- 
ture of the other video decoder used in the sixth exam- 



ple. 

[0368] As shown in Figure 77, the video decoder 
includes VPTS detection means 1001 for detecting a 
VPTS indicating the reproduction time of the video sig- 
nal multiplexed as the compression video signal, video 
extension means 1002 for extending the MPEG com- 
pression video stream, reference time signal generation 
means 1004 for generating a reference time signal, and 
video reproduction timing control means 1003 for com- 
paring the reference time signal and the VPTS and skip- 
ping or repeating the video reproduction on a frame-by- 
frame basis when the comparison result exceeds the 
threshold value and also for outputting a horizontal syn- 
chronization signal and a vertical synchronization signal 
for the picture reproduced. 

[0369] As shown in Figure 78, the other video decoder 
includes VPTS detection means 1101 for detecting a 
VPTS indicating the reproduction time of the video sig- 
nal multiplexed as the compression video signal, video 
extension means 1102 for extending the MPEG com- 
pression video stream, reference time signal generation 
means 1 104 for generating a reference time signal, and 
video reproduction timing control means 1003 for com- 
paring the reference time signal and the VPTS and skip- 
ping or repeating the video reproduction on a frame-by- 
frame basis when the comparison result exceeds the 
threshold value, for outputting a horizontal synchroniza- 
tk)n signal and a vertical synchronization signal for the 
picture reproduced, and also reproducing the extended 
video signal in synchronization with the horizontal^erti- 
cal synchronization signals. 

[0370] The video decoders are connected to each 
other so that the horizontal synchronization signal and 
the vertical synchronization signal output from the video 
decoder in Figure 77 are sent to the video decoder in 
Figure 78. 

[0371 ] In the optical disk reproduction apparatus in the 
sixth example having the above-described structure, the 
reference time signal generated by each video decoder 
is corrected with an APTS. and the video reproduction 
timing control means of each video decoder maintains 
the difference between each reference time signal and 
each VPTS to be equal to or less than the threshold 
value. Thus, the right-eye picture and the left-eye pic- 
ture can be synchronized with one another on a frame- 
by-frame basis. By using the horizontal and vertical syn- 
chronization signals output by one of the video decoder 
as the horizontal and the vertical synchronization sig- 
nals of the other video decoder, two pictures can be 
reproduced in synchronization on a pixel-by-pixel basis. 
[0372] In the sixth example, compression video sig- 
nals obtained from a 3D video signal are used and 
divided into the right-eye and left-eye signals. Alterna- 
tively, for example, an original video signal having a first 
resolution is divided in a vertical and/or horizontal direc- 
tion into at least two video signals including a first video 
signal and a second video signal having a second reso- 
lution which is lower than the first resolutioa The resuH- 
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ant signals are compressed to be used. Thus, a plurality 
of video signals in synchronization with one another on 
a pixel-by-pixel basis can be obtained as from a 3D 
video signal. By synthesizing such resultant signals, the 
clear original video signal having the original resolution 
Is reproduced. 

(Example 7) 

[0373] The seventh example relates to an optical disk 
reproduction apparatus for extending one compression 
video signal and two compression audio signals and 
reproducing the signals simultaneously. 
[0374] Figure 81 shows a data structure of the optical 
disk used In the seventh example. 
[0375] Two audio signals D and E are compressed to 
obtain compression audio streams D and E. A video sig- 
nal is compressed to obtain a compression video 
stream. 

[0376] The compression audio streams D and E and 
the compression video stream are packeted in units of 2 
kB into audio packets and video packets. A packet 
header of each packet includes a stream ID for indicat- 
ing which of the compression audk> streams D and E 
and the compression video stream is stored, and the 
ARTS and VPTS. 

[0377] Figure 79 is a block diagram of the reproduc- 
tion apparatus in the sixth example. 
[0378] The reproduction apparatus has a generally 
similar structure to that in Rgure 68. The audio decoder 
541 has the same structure as that shown in Rgure 69, 
and the video decoder 531 has the same structure as 
that shown in Figure 65. The audio decoder 591 has the 
same structure as that shown in Figure 80. 
[0379] Reference numeral 590 represents a buffer 
memory for temporarily storing the compression audio 
signal like the buffer memory 540. Reference numeral 
592 represents a speaker for reproducing the audio sig- 
nal. 

[0380] Figure 80 shows a structure of the audio 
decoder 591. The audio decoder 509 includes APTS 
detection means 1201 for detecting an APTS stored in a 
packet header of the audio packet, audio extension 
means 1202 for extending the compression audio 
stream, and audio reproduction timing control means 
1203 for comparing the reference time signal and the 
APTS and skipping or repeating the audio reproduction 
on an audio frame-tiy-audio frame basis when the com- 
parison result exceeds the threshold value. 
[0381 ] A reproduction operation in the seventh exanrt- 
ple willbedesaibed. 

[0382] The operation until the signal read from the 
optical disk 501 is input to the division means 505 is 
simitar to that in the other examples. 
[0383] The data read from the buffer memory 504 is 
divided by the division means 505 into a compression 
video signal, the compression audio signal D and the 
compression audio signal E, and output. The division 



means 505 klentlfies which of the compression video 
signal, the compression audio signal D and the com- 
pression audio signal E is stored in each packet with the 
packet ID in the packet header of the packeted data, 
B and determines the destination based on the identifica- 
tion result. 

[0384] The divided compression video signal, the 
compression audio signal D and compressfon audio sig- 
nal are temporarily stored in buffer memories 530. 540 

TO and 590 respectively. 

[0385] The video decoders reads data from the buffer 
memory 530, extends the compression video signal and 
outputs the signal as a video signal to a monitor 532. 
The audio decoders 541 and 591 read data from the 

15 buffer memories 540 and 590, extend the compression 
audio signals and output the signals as audio signals 
through the speakers 542 and 592. 
[0386] The reference time signal generated by the ref- 
erence time signal generation means 506 is oon-ected 

20 by an APTS#D detected by the audio decoder 541 . 
[0387] In the audio decoder 591. an APTS#E is 
detected by the APTS detection means 1201 and the 
compression audio signal E is extended Isy the audto 
extension means 1202. The audto reproduction timing 

25 control means 1 203 receives the extended audio signal 
output from the audio extension means 1202, the refer- 
ence time signal, and the APTS#E from the APTS 
detection means 1201, compares the reference time 
signal and the APTS#E. When the difference between 

30 the reference time signal and the APTS#E exceeds the 
threshold value, the audio reproduction timing control 
means 1203 controls the audio reproduction timing so 
that the difference is equal to or less than the threshoM 
value. 

35 [0388] In the seventh example, 32 msec is used as the 
threshold value. The video reproduction timing control 
means 1203 performs the folfowlng. 

(reference time 8ignal-APTS#E)>32 msec.:1 audk) 
40 frame is skipped. 

(reference time signal-APTS#E)<-32 msec.:1 audio 
frame is repeated. 

[0389] The operation of tiie video decoder 531 for 
45 extending the compression video signal and correction 
performed when the difference between the reference 
time signal and the VPTS exceeds the threshoW value 
are similar to those in the second exampla 
[0390] In the seventh example, due to the precision 
50 enor of the crystal oscillator used in the reference time 
signal generation means 506. the video decoder 531 . 
and the audio decoders 541 and 591; the audio decod- 
ers 541 and 591 are slower and the video decoder 531 
is faster in terms of extension and reproduction with 
55 respect to the reference time signal. Unless reproduc- 
tion timing is corrected, the reproduced video signals 
are out of synchronization. 

[p391] Figure 82 is a timing diagram of video repro- 
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duction in the seventh example. Part (a) of Figure 82 
shows the APTS#D with respect to reproduction time t. 
Part (b) shows the reference time signal, part (c) shows 
APTS#E, at which the compression audio signal E to be 
extended by the audio decoder 531 is to be reproduced, s 
and part (d) shows the VPTS, at the compression video 
signal to be extended by the video decoder 531 is to be 
reproduced. The reference time signal is corrected 
using the APTS#D when APTS#D shows ta3 and ta4. 
The reference time signal is reset to ta3 and ta4 at the w 
respective time. 

[0392] The audio decoder 591 continues extension 
and reproduction of the compression audio signal E, 
and the difference between the VPTS#E and the refer- 
ence time signal exceeds 32 msec, as the threshold is 
value at T10. Accordingly, the video reproduction timing 
control means 1 203 of the audio decoder 591 skips one 
audio frame which is originally to be reproduced to cor- 
rect the reproduction timing so that the difference 
between the VPTS#E and the reference time signal is 2o 
equal to or less than the threshold value. 
[0393] The difference between the VPTS and the ref- 
erence time signal exceeds -33 msec, as the threshold 
value at T11 and T12. Accordingly, the video reproduc- 
tion timing control means of the video decoder 531 25 
reproduces one frame in repetition which has been 
already reproduced at the respective time to correct the 
reproduction timing so that the difference between the 
VPTS and the reference time signal is equal to or less 
than the threshold value. 30 
[0394] As described above, in the seventh example, 
when the difference between the reference time signal 
and the VPTS#E detected by the audio decoder 591 
exceeds the threshold value, the video reproduction tim- 
ing control means of the audio decoder performs cor- 35 
rection so that difference fcietween the reference time 
signal and the APTS#E does not exceed the threshold 
valua In this manner, each audio signal and the picture 
can be synchronized with one another. 

40 

(Examples) 

[0395] In the eighth example, the clock for performing 
extenston is changed for audio reproduction control. 
[0396] The overall structure and operation of the 45 
reproduction apparatus in the eighth example are gen- 
erally similar to those of the optical disk reproduction 
apparatus in the seventh eixample, but the operation of 
audio reproduction timing control performed when the 
reference time signal and the APTS#E exceeds the so 
threshold value is different from that of the seventh 
example. With reference to Figure 83 and 84, audio 
reproduction timing control used in the eighth example 
win be described. 

[0397] Rgure 83 shows an operation when the differ- 55 
ence between the APTS#E and the reference timing 
signal exceeds 32 msec. Which is the threshold for the 
audio reproduction. Part (a) of Rgure 83 shows the ref- 



erence time signal with respect to reproduction time t. 
Part (b) shows the APTS#E, and part (c) shows the 
dock frequency at which the audio decoder 591 per- 
forms extension and reproduction. Ordinary extension 
and reproduction are perfbrmed by dockfO having a fre- 
quency which is 384 limes the sarrpling frequency fs of 
the audio signal. The difference between the APTS#E 
and the reference time signal exceeds 32 msec, at time 
T1 1 , and accordingly, audio reproduction control means 
switches the clock fO to f1 . The frequency of dock f 1 is 
higher by 1 0% than the frequency of clock fO. Extension 
performed with clock f 1 proceeds faster than extension 
performed wHh ckxk fO by 10%. With dock f1, the 
extension is performed for 320 msec, firom the point 
where the difference between the APTS#E and the ref- 
erence time signal exceeds 32 msec. Which is the 
threshold value. Thus, the reproduction timing is cor- 
rected so that the difference between the APTS#E and 
the reference time signal is equal to or less than the 
threshold value. 

[0398] Figure 84 shows an operation when the differ- 
ence between the APTS#E and the reference timing 
signal exceeds -32 msec, which is the threshold for the 
audio reproduction. Part (a) of Figure 83 shows the ref- 
erence time signal with respect to reproduction time t. 
Part (b) shows the APTS#E, and part (c) shows the 
dock frequency at which the audio decoder 591 per- 
forms extenston and reproduction. 
[0399] The difference between the APTS#E and the 
reference time signal exceeds -32 msec, at time T12, 
and accordingly, audio reproduction control means 
switches the clock fO to f2. TTie frequency of dock f2 is 
lower by 10% than the frequency of dock fO. Extenston 
perfbrmed with clock f2 proceeds more slowly than 
extension perfbrmed with clock fO by 10%. With clock f2, 
the extension is performed for 320 msec, from the point 
where the difference between the APTS#E and the ref- 
erence time signal exceeds -32 msec, which is the 
threshold value. Thus, the reproduction timing is cor- 
rected so that the difference between the APTS#E and 
the reference time signal is equal to or less than the 
threshold value. 

[0400] As described above, when the difference 
between the APTS#E and the reference time signal 
exceeds the threshold value for the audio reproduction, 
the clock by which the signal is extended is changed so 
that the extension is performed at a higher speed or 
kiwer speed than the normal speed. By such an opera- 
tion, the reproduction timing is controlled so that the dif- 
ference between the APTS#E and the reference time 
signal is equal to or less than the threshold value. Thus, 
the audio signals and the video signal can be repro- 
duced in synchronization with no unnaturalness in the 
audio output 

[0401] In the eighth example, the frequency of the 
dock is changed by 10%. Needless to say. a more nat- 
ural audio signal is obtained by reducing the dock less 
or gradually. 
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[0402] In the seventh and eighth examples, the refer- 
ence time signal is corrected using the APTS#D. Alter- 
natively, the video decoder shown in Figure 73 can be 
used, in which case the VPTS output from the video 
decoder can be used for con'ectlon. 
[0403] Tlie present invention has been described by 
way of specific examples. 

[0404] The comparison between the reference time 
signal and the VPTS or APTS. control of the reproduc- 
tion time, correction of the reproduction timing can be 
performed by a microcomputer which controls the 
entirety of the reproduction apparatus. 
[0405] In the above examples, the present invention is 
applied to optical disk reproduction devices. The 
present invention is also applicable to a reproduction 
apparatus for extending signals supplied through com- 
munication networks and digital satellite broadcasting 
as compression signals. 

INDUSTRIAL APPLICABILITY 

[0406] A tsasic video signal and an interpolatton signal 
are divided Into frames each having 1 OOP or more and 
subjected to interleaving alternately to be recorded on 
the optical disk as Interleave blocks 54 and 55. From 
such an optical disk, a progressive/3D reproduction 
apparatus reproduces both information in the interleave 
block for the odd field (right eye) and information in the 
interleave block for the even field (left eye). Thus, a pro- 
gressive/SD picture is obtained. A non-progressive/3D 
reproduction apparatus reproduces information in the 
interleave bkxdc of only odd field (right eye) or even field 
(left eye) by track jump. Thus, a complete two-dimen- 
sional picture is obtained. Thus, compatibility is real- 
ized. 

[0407] Especially, a progressive/3D picture arrange- 
ment infomnatton file and a progressive^D picture iden- 
tifier are recorded on the optical disk. Accordingly, the 
location of the progressive/3D is easily determined. 
Therefore, two ordinary interlace signals can be made 
into a progressive signal. Furthermore, it can be 
avoided that pictures for the right eye and left eye of dif- 
ferent contents are output on the 3D TV. 
[0408] In a 3D reproduction apparatus, a pointer used 
for two-dimensional display is used when an 3D identi- 
fier is available to change the access process. Thus. 3D 
pictures can be continuously displayed. Moreover, a 3D 
reproduction apparatus is realized without changing the 
two-dimensional format 

[0409] According to the synchronization method of the 
present invention, a plurality of vMeo signals or a plural- 
ity of audk) signals to be simultaneously reproduced are 
extended in synchronization for reproductbn. 
[041 0] In the emtxxiiment where a horizontal synchro- 
nization signal and a vertical synchronization signal 
which are output from one video decoder are used as 
the horizontal synchronization si^ and the vertical 
synchronization signal of another video decoder, syn- 



chronization on a pixel-by-plxel basis is realized even 
when, for example, a plurality of compression video sig- 
nals are extended and the extended signals are synthe- 
sized into a 3D picture or a high resolution picture. 

5 [041 1 ] In a reproduction apparatus in which the refer- 
ence time signal is con-ected using an APTS detected 
by an audio decoder and the video output timing is con- 
trolled so that the VPTS matches the corrected refer- 
ence time signal, an audk) signal and a plurality of video 

10 signals are synchronized for reproductnn with no 
unnaturalness in the audio output. 
[041 2] In a reproduction apparatus in which the audk) 
output timing is controlled by changing an extension 
docK audk) and video signals are synchronized for 

15 reproduction with no unnaturalness in the audio output 
with no interruption or pause in the audio signal. 

aaims 

20 1. An optical disk reproduction apparatus for repro- 
ducing data in an optical disk, in which the optical 
disk has at least a first video stream corresponding 
to a first signal source and a second video stream 
corresponding to a second signal source recorded 

25 on the optica] disk, the first video stream includes a 
plurality of first interleave units and the second 
video stream includes a plurality of second inter- 
leave units, each of the plurality of first interleave 
units is mi pieces of GOPs. each of the plurality of 

30 second Interleave units is mg pieces of GOPs, the 
first interleave units and the second interleave units 
are recorded on the optical disk In a prescribed 
order, each of the plurality of first interleave units 
corresponds to first time information related to 

35 reproduction time, and each of the plurality of sec- 
ond interleave units corresponds to second time 
information related to reproduction time, the optical 
disk reproduction apparatus comprising: 

40 a reproduction section for reproducing a signal 

recorded on the optical disk; 
a division section for divkling the reproduced 
signal into the plurality of first interleave units 
Included in the first vkleo stream and the piural- 

45 ity of second interleave units included in the 

second video stream; 

a decoding section for decoding the first inter- 
leave units and the second interleave units: 
and 

50 an output section for outputting the decoded 

first interleave unit and the decoded second 
Interleave unit substantially simultaneously 
based on the first time informatton correspond- 
ing to the first interleave unit and the second 

55 time information corresponding to the second 

interleave unit. 

wherein m^ and nrtg are each an integer of one 
ornmre. 
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2. An optical disk reproduction apparatus according to 
claim 1, further comprising a synthesis section for 
synthesizing the decoded first interleave unit and 
the decoded secorKi interleave unit. 

3. An optical disk reproduction apparatus according to 
claim 2. wherein: 

a high resolution video signal includes a low 
resolution component and a high resolution 
component, 

the first video stream represents the low reso- 
lution component, 

the second video stream represents the high 
resolution component, and 
the synthesis section synthesizes the decoded 
interleave unit and the decoded second inter- 
leave unit to generate the high resolution video 
signal. 

4. An optical disk reproduction apparatus according to 
claim 2, wherein: 

a three^mensional video signal includes a 

right-eye signal and a left-eye signal, 

the first video stream represents the right-eye 

signal, 

the second video stream represents the left- 
eye signal, and 

the synthesis section synthesizes the decoded 
first interleave unit and the decoded second 
interleave unit, thus generating the three- 
dimensKKial video signal. 

5. An optical disk reproduction apparatus according to 
claim 2, wherein the synthesis section performs a 
prescrit>ed first calcutatlon to the first interleave unit 
and the second interleave unit peribrms a pre- 
scrik>ed second calculatton to the first interleave unit 
and the second interleave unit, and synthesizes a 
result of the prescribed first calculation and a result 
of tiie prescribed second calculation, thus generat- 
ing a synthesis signal. 

6. An optical disk reproduction apparatus according to 
claim 5, wherein tiie prescribed first calculation 
includes a sum Galculation of tiie first interleave unit 
and ttie second interleave unit, and tiie prescribed 
second calculation includes a difference calculation 
of ttie first interleave unit and the second interleave 
unit. 

7. An optical disk reproductkHi apparatus according to 
claim 6. wherein the first calculation further 
includes a calculation of adding a first value to a 
result of ttie sum calculation, and ttie second calcu- 
lation further includes a calculation of adding a sec- 
ond value to a result of the difference catoulation. 



8. An optical disk reproduction apparatus according to 
daim 6, wherein the synthesis section assigns ttie 
result of the first calculation to picture data of an 
Slh line and assigns tiie result of the second calcu- 

5 lation to picture data of an )tti line, and S is an 
integer. 

9. An optical disk reproduction apparatus according to 
daim 8. for reprodudng an optical disk obtained by 

10 performing a first division calculation and a second 
division calculation on a Pth frame of an input video 
signal using video data of at least a 2Q'th line and a 
(2C>f1)th line of ttie input video signal, kxating a 
result of ttie first diviston cateulation in a 2Q1h line 

IS of ttie first video sb'eam, locating a result of the sec- 
ond division calculation in a 2Q1h line of the second 
video sti'eam, performing the first division calcula- 
tion and the second division calculation on a 
(P+1)th frame of the input video signal using video 

20 data of at least ttie 2Q'tti line and ttie (2Q+1)th line 
of the input video signal, locating a result of ttie first 
division calculation in a (2Q+1)tti line of ttie first 
video stream, and locating a result of ttie second 
diviston calculation in a (2Q+1)tii line of ttie second 

zs video stream, 

wherein the synthesis section performs ttie 
sum calculation and the difference calculation of a 
video signal of a 2Q'tii or a 2(Q+1}th line of a 
decoding signal of the first video stream and a 

30 video signal of the 2Q1h or ttie (2Q+1 )th line of tiie 
second video sb'eam, thus generating a synthesis 
signal which has a result of ttie sum calculation as 
a video signal of a 2R1h line and a result of the dif- 
ference calculation as a video signal of a (2R-i-i)tti 

35 line; and R and Q are each an integer, and R has a 
specific relationship with Q. 

1 a An optical disk reproduction apparatus according to 
daim 6, wherein ttie synttiesis section generates a 
40 synthesis signal using color information of ttie first 
video sti-eam but wittiout using color information of 
ttie second video stream. 

11. An optical disk reproduction apparatus according to 
4S daim 6, wherein: 

the high resolution video signal includes a low 
resolution component and a high resolution 
component, and 

50 the synthesis section transforms a parameter 

of the sum calculation and the difference calcu- 
lation based on filter identification information 
which represents a division filter parameter of 
the high resolution component and the lew res- 

55 olution component. 

1 2. An Gptk»l disk reproduction apparatus according to 
daim 5. wherein: 
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a high resolution video signal Includes a low 
resolution conponent and a high resolution 
component. 

the first video stream represents the low reso- 
lution component, 

the second video stream represents the high 
resolution component, and 
the synthesis section generates a synthesis 
signal using color information of the first video 
stream but without using color information of 
the second video stream. 

1 3. An optical cGsk reproduction apparatus according to 
claim 5, wherein: 

a high resolution video signal includes a low 
resolution component and a high resolution 
component, 

the first video stream represents the low reso- 
lution componerrt, 

the second video stream represents the high 
resolution component, and 
the synthesis section alters a calculation 
parameter in accordance with division infomia- 
tion which represents a division parameter 
when the high resolution signal is separated 
from the low resolution signal, the division infor- 
mation being reproduced from the optical disk. 

14. An optical disk reproduction apparatus according to 
claim 13. wherein a filter constant is used as the 
calculation parameter. 

1 5. An optical disk reproduction apparatus according to 
claim 5, wherein the synthesis section synthesizes 
the result of the prescribed first calculation and the 
result of the prescribed second calculation in a ver- 
tical direction. 

1 6. An optical disk reproduction apparatus according to 
claim 5, wherein the synthesis section synthesizes 
the result of the prescribed first calculation and the 
result of the prescribed second calculation in a hor- 
izontal direction. 

1 7. An optical disk reproduction apparatus according to 
daim 5. wherein the synthesis section transforms 
the synthesis signal into a progressive signal. 

18. An optical disk reproduction apparatus according to 
claim 2, wherein the decoding section performs 
decoding using a motion compensation signal of 
the first video stream as a ntotion compensation 
signal of the second video stream. 

1 9. An optical disk reproduction apparatus according to 
claim 2, further comprising video identification 
means for identifying identification information 



which indicates that a high resolution video signal 
or a three-dimensional video signal are recorded, 
wherein: 

5 when the video identification means identifies 

the identification information, the optical disk 
reproduction apparatus optionally reproduces 
both the first interleave unit and the second 
interleave unit, and 

10 the decoding section and the synthesis section 

respectively decodes and synthesizes the high 
resolution video signal and/or the three-dimen- 
sional video signal. 

15 20. An optical disk reproduction apparatus according to 
daim 19, wherein, when the video identification 
means does not reproduce the identification infor- 
mation, the optical disk reproduction apparatus 
opttonally reproduces only the first interleave unit. 

20 

21. An optical disk reproduction apparatus according to 
daim 20, wherein, when the video identification 
means does not reproduce the identification infor- 
mation, the optical disk reproduction apparatus 
25 optionally reproduces only the first interleave unit 
and outputs the first interleave unit with the number 
of scanning lines of the first signal source being 
inaeased. 

30 22. An optical disk reproduction apparatus according to 
daim 1. for reproducing an optical disk having first 
reproduction information indicating that information 
for reproducing the first interleave unit is present 
and information for reprodudng the second inter- 

35 leave unit is absent, second reproduction informa- 
tion indicating that information for reprodudng the 
first interleave unit and information for reproducing 
the second interieave unit are both present identifi- 
cation information indicating that the first reproduc- 

40 tion information is valid, and high resolution video 
signal/three-dimensional video signal recording 
identification information indicating that high resolu- 
tion or three-dimensional video signal is divided into 
the first video stream and the second video stream, 

46 wherein, when the high resolution video sig- 

nal/three-dimensional video signal recording identi- 
fication information is detected, the optical disk 
reproduction apparatus optfonally reproduces both 
the first interleave unit and the second interieave 

50 unit in accordance with the second reproduction 
information. 

23. An optical disk reproduction apparatus according to 
daim 22. wherein the optfoal disk reproductfon 
55 apparatus reproduces the second reproduction 
information to acquire starting position information 
of an imnrtediately subsequent interleave unit of a 
specific interleave unit in each video stream, and 
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thus reproduces both the first interleave unit and 
the second interleave unit 

24. An optical disk reproduction apparatus according to 
claim 22, wherein, when the high resolution video 
signal/three-dimensional video signal recording 
identification information is not detected, the optical 
disk reproduction apparatus reproduces the first 
interleave unit in accordance with the first reproduc- 
tion information. 

25. An optical disk reproduction apparatus according to 
claim 1 , wherein the optical disk stores n pieces of 
video streams respectively corresponding to n 
pieces of signal sources, and 

the optical disk reproduction apparatus further 
comprises a selection section for selecting i 
pieces of video streams including the first video 
stream and the second video stream from the n 
pieces of video streams, and n and i are each 
an integer of two or mora 

26. An optical disk reproduction apparatus according to 
claim 25, wherein the division section includes a 
buffer section for buffering the i pieces of video 
streams, and the buffer section has a total capacity 
of 1 102x(i-i) kbyte or more. 

27. An optical disk reproductton apparatus according to 
daim 26, wherein 132. 

28. An optical disk reproductkm apparatus according to 
claim 1 , wherein at least the first video stream and 
the second video stream are decoded simultane- 
ously, and a one-screen video signal having the first 
video stream located on a first area and the second 
video stream located on a second area is output 

29. An optical disk reproduction apparatus according to 
claim 28, wherein the first area and the second area 
are different from each other in a horizontal direc- 
tion. 

30. An optical disk reproduction apparatus according to 
claim 29, wherein the synthesis section includes a 
line memory. 

31 . An optical disk reproduction apparatus according to 
claim 28, wherein information displayed on the first 
area is enlarged or reduced in accordance with an 
externally input instruction signal. 

32. An optical disk reproductk>n apparatus according to 
claim 31, wherein the syrrthesis section includes a 
frame memory. 

33. An optical disk reproduction apparatus according to 



daim 31 , wherein the first area is enlarged and the 
second area is reduced in accordance with an 
externally Input instruction signal. 

s 34. An optical disk reproduction apparatus according to 
daim 28, wherein a sub picture of either one of tiie 
first video stream and the second video stream is 
displayed. 

w 35l An optical disk reproduction apparatus according to 
daim 28, wherein a frame memory is used to con- 
tinuously display the first video stream on ttie first 
area, n pieces of display areas are provided to dis- 
oontinuously display an nih stream in an nih area. 
IS and n is an integer of one or mora 

36. An optical disk reproduction apparatus according to 
daim 28, wherein only an audio signal of the first 
video stream is output. 

20 

37. An optical disk reproduction apparatus according to 
daim 28, wherein an audio signal of the first video 
stream and an audio signal of tiie second video 
stream are output, and the audio level of tiie second 

25 video stream is lowered. 

38. An optical disk reproduction apparatus according to 
daim 1. wherein tiie output section outputs tiie first 
video stream as a right-eye signal and the second 

30 video stream as a left-eye signal. 

39. An optical disk reproduction apparatus according to 
daim 38, wherein the oulput section outputs tiie 
first video stream to a right-eye video oulput section 

3S and the second video stream to a left-eye video out- 
put section. 

40. An optical disk reproduction apparatus according to 
daim 39, wherein tiie output section outputs a syn- 

40 chronization signal for tiiree-dimensional specta- 
des, tiie synchronization signal including an 
identification signal of the left-eye signal and the 
right-eye signal. 

45 41. An optical disk reproduction apparatus according to 
daim 39. wherein the oulput section outputs the 
tiiree-dimensional video only when a three-dimen- 
sional vkleo output instxiction is issued. 

so 42. An optical disk reproduction apparatus according to 
daim 39. wherein, while an area storing a three- 
cfimensional video signal is reproduced, the output 
section outputs a display to a display section that 
the three-dimensional video signal is being repre- 
ss duced. 

43. An optical disk reproduction apparatus according to 
daim 38. wherein the output section indudes a mix- 
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ture synthesis section for synchronizing the time 
information of the first video stream and the time 
information of the second video stream, mixes the 
first and second video streams on a f ield-by-fleld 
t>asis or on a frame-by-frame basis, and outputs the 
first and second video streams alternately. 

44. An optical disk reproduction apparatus according to 
claim 43, wherein the output section includes a 
three-dimensional switch signal section for output- 
ting a signal for switching the left-eye signal and the 
right-eye signal. - 

45. An optica) disk repFoductk>n apparatus according to 
claim 43, wherein the mixture synthesis section 
identifies the signal is a three-dimensional video 
signal and mixes ttie first video stream and the sec- 
ond video stream only when a ttiree-dimensional 
video output Instruction is issued. 

46. An optical disk reproduction apparatus according to 
claim 43, wherein, when a non three-dimensional 
video signal is output while an area storing a tfiree- 
dimensional video signal is reproduced, the output 
section provides an output video signal with a dis- 
play tiiat tiie three-dimensional video signal is 
being reproduced. 

47. An optical disk reproduction apparatus according to 
claim 38, wherein, when a non three-dimensional 
video signal is output while an area storing a three- 
dimen8k)nal video signal is reproduced, the output 
section provides an output video signal with a dis- 
play ttiat the tivee-dimensional video signal is 
being reproduced. 

48. An optical disk reproduction apparatus according to 
daim 2. for receiving a compressed video stream 
obtained by compressing each of a plurality of 
video signals to be reproduced in synchronisation 
and a plurality of conpressed video signals 
obtained by multiplexing video reproduction time 
information indicating tiie time to reproduce the 
video signal and then performing extenskm and 
reproduction, the optical disk reproductk)n appara- 
tus furttier comprising: 

reference time signal generation means for 
generating a reference time signal; and 
a plurality of video extension reproduction 
means for extending the compressed video 
stream and controlling the reproduction time of 
the video signal which has been extended In 
accordance witii ttie difference between tiie 
reference time signal and tiie vkJeo reproduc- 
tion time information. 

wherein the reference time signals of the plu- 
rality of video extenskm reproduction means 



are compensated for at substantially tiie same 
time using same information. 

49. An optical disk reproduction apparatus according to 
5 daim 48, further comprising at least one audio sig- 
nal extension reproduction means for receiving a 
compressed audio sti'eam obtained by compress- 
ing an audio signal to be reproduced in synchroni- 
sation with the video signals and at least one 
10 compressed audio signal obtained by multiplexing 
audio reproduction time information indicating the 
time to reproduce tiie audio signal, then extending 
the compressed audio stream, and outputting tiie 
audio reproduction time information, 
15 wherein tiie reference time signal is com- 

pensated for by using the audio reproduction time 
information output by tiie audk) extension reproduc- 
tion means. 

20 50. An optical disk reproduction apparatus according to 
daim 48, wherein at least one of the plurality of 
video extension reproduction means outputs video 
reproduction time information, and the reference 
time signal Is compensated for by using the video 

25 reproduction time information output by at least 
ones of tiie plurality of the vkleo extension repro- 
duction means. 

51 . An optical disk reproduction apparatus according to 
30 daim 48. wherein the video extension reproduction 

means skip-reproduce or repeat-reproduce a frame 
of the video signal to control tiie reproduction time. 

52. An optical disk reproduction apparatus according to 
35 daim 48, wherein at least one of the plurality of tiie 

video extension reproduction means outputs a hor- 
izontal synchronization signal and a vertical syn- 
chronization signal of the video signal, thus to 
synchronize video reproduction performed by 
40 another video extension reproduction means to tiie 
horizontal synchronization signal and the vertical 
synchronization signal. 

53. An optical disk reproductk>n apparatus for repro- 
45 ducing an optical disk, in which the optical disk 

Stores at least one audio sti'eam, tiie audio stream 
indudes a plurality of compressed audio signals, 
and each of the plurality of compressed audio sig- 
nals con^esponds to time informatnn related to 
so reproduction time, tiie optical disk reproduction 
apparatus comprising: 

a reproduction section for reprodudng a signal 
recorded on the optical disk; 
55 a division section for dividing tiie reproduced 

signal into a plurality of compressed audio sig- 
nals induded in the audio stream; 
reference time signal generation means for 
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generating a reference time signal: 

an extension section for extending the plurality 

of audio signals; and 

an output section for controlling timing for out- 
putting the extended audio signal based on the 
difference between the time information corre- 
sponding to each of the plurality of compressed 
audio signals and the reference time signal. 

54. An optical disk reproduction apparatus according to 
claim 53, wherein at least one of a plurality of output 
sections outputs audio reproduction, and the refer- 
ence time signal is compensated for by using the 
audio reproduction time information output by the at 
least one of a plurality of output sectfons. 

55. An optical disk reproduction apparatus according to 
claim S3, further comprising at least one video sig- 
nal extension reproduction means for receiving a 
compressed video stream obtained by compress- 
ing a video signal to be reproduced in synchroniza- 
tion with the audio signal and at least one 
compressed video signal obtained by multiplexing 
video reproduction time information indicating the 
time to reproduce the video signal, then extending 
the compressed video stream, and outputting the 
video reproduction time information, 

wherein the reference time signal is com- 
pensated for using the video reproduction time 
information output by the video extension reproduc- 
tion means. 

56. An optical disk reproduction apparatus according to 
claim 53. wherein the audio stream is obtained by 
compressing an audio signal every time unit 
referred to as audio frame, and the output section 
skip-reproduces or pauses the audio frame to con- 
trol the reproduction time. 

57. An optical disk reproduction apparatus according to 
claim 53, wherein the output section changes a fre- 
quency of a dock for performing extension repro- 
duction to control the reproduction time. 

58. An optical disk having at least a first video stream 
corresponding to a first signal source and a second 
video stream con-esponding to a second signal 
source recorded on the optical disk, wherein the 
first video stream includes a plurality of first inter- 
leave units arKl the secorui video stream includes a 
plurality of second interleave units, each of the plu- 
rality of first interleave units is m^ pieces of GOPs, 
each of the plurality of second interleave units is 
pieces of GOPs, the first interleave units and the 
second interleave units are recorded on the optical 
disk in a presaibed order, each of the plurality of 
first interleave units corresponds to first time infor- 
matfon related to reproduction time, and each of ttie 



plurality of second interleave units oonresponds to 
second time information related to reproduction 
time. 

5 59. An optical disk according to daim 58, wherein: 

a high resolution video signal includes a low 
resolution component and a high resolution 
component, 

10 the first video stream recorded on the optical 

disk represents the low resolution component, 
and 

tiie second vMeo stream recorded on the opti- 
cal disk represents the high resolution compo- 
is nent 

60. An optical disk according to daim 59. wherein: 

the fow resolution component of tiie first video 
20 stream recorded on the optical disk is gener- 

ated by a sum calculation of specific two or 
more signals of the high resolution signal, and 
the high resolutfon component of ttie second 
video stream recorded on the optical disk is 
2S generated by a difference calculation of spe- 

cific two or more signals of the high resolution 
signal. 

' 61. An optical disk according to claim 60. wherein the 
30 low resolution component of the first video stream 
recorded on the optical disk and tiie high resolution 
component of tiie second video stream recorded on 
tiie optical disk are generated as a result of divisfon 
performed in a vertical direction by video signal divl- 
35 sion means. 

62. An optical disk according to claim 61 . wherein: 

the first video stream has. in a 2Qth line, a 

40 result of a first division calculation performed 

on a P'tii frame of an input video signal using 
video data of at least a 2Q'th line and a 
(20+1 )th line of the input video signal, 
the second video stream has, in a 2Q1h line, a 

45 result of a second division calculation per- 

formed on a Pth frame of the input video signal 
using video data of at least a 2Qlh line and a 
(2Q+1)th line of the input video signal, 
the first video stream has, in a (2Q+l)tti line, a 

50 result of the first division calculation performed 

on a (P+1)tti frame of the input video signal, 
the second video stream has, in a (2Q-t-1)th 
line, a result of tiie second division calculation 
performed on a (P+1)th frame of the input 

55 video signal, and 

P and Q are each an integer. 

63. An optical disk according to daim 59, wherein the 
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low resolution component of the first video stream 
recorded on the optical disk and the high resolution 
component of the second video stream recorded on 
the optical disk are generated as a result of division 
performed in a vertical direction by video signal divi- 
sion means. 

64. An optical disk according to daim 59, wherein the 
first video stream recorded on the optical disk and 
the second video stream recorded on the optical 
disk are generated t)y dividing a high resolution 
video signal in a horizontal direction by video signal 
division means, so that the first video stream has a 
horizontal low resotutton component and the sec- 
ond video stream has horizontal high resoiutton 
component. 

65. An optical disk according to claim 64. on which 
overlapping field or frame signals are recorded in a 
video signal in an abbreviated encoded state, and 
an identifier is recorded indicating the abbreviated 
field or frame signal. 

66. An optk^l disk according to daim 59. on whk^h 
identification information is recorded indicating a 
calculation parameter used for the division calcula- 
tion for dividing a video signal. 

67. An optical disk according to daim 59, wherein 
nrxrtion vector information of a video encoding sig- 
nal of the first video stream and motion vector infor- 
mation of a video encoding signal of the second 
video stream have an klentical value. 

68. An optical disk according to claim 58, on which at 
least the first video stream and the second video 
stream are recorded while being encoded by a sub- 
stantially klentical signal format. 

69. An optical disk according to daim 68, wherein the 
substantially identical signal format is obtained by 
encoding an NTSC. PAL or SECAM signal. 

70. An optical disk according to daim 58. where inter- 
leave units corresponding to each of first through 
m*th streams are 1st through mlh interleave units, 
the optical disk has: 

first reproduction information including informa- 
tion for reproducing the first interleave unit but 
excluding information for reproducing the sec- 
ond interleave unit; 

second reproduction information induding both 
information for reprodudng the first interleave 
unit and information for reprodudng the second 
interleave units; and 

an identifier for maMng the second reproduc- 
tion infbrnriation valid. 



71. An optical disk according to daim 70. wherein 
reproduction information of one interleave unit 
indudes leading position information of another 
interleave unit, wherein the another interleave unit 
5 belongs to the same stream as the one interleave 
unit and is the next dosest interleave unit to the one 
interleave unit among interleave units having time 
information. 

10 72. An optical disk according to daim 71, on which 
reproduction information of the first interleave unit 
in a first table is recorded as the first reproduction 
information, reproduction information of the first 
interleave unit and the second interleave unit in a 

IS second table is recorded as the second reproduc- 
tion information, and an identifier is recorded indi- 
cating that the first table Is valkJ. 

73. An optical disk according to claim 72, on which a 
20 table for seamless reproduction is recorded as the 
first table, a table for non-seamless reproduction is 
recorded as the second table, and an identifier is 
recorded indicating the seamless reproduction. 

25 74. An optical disk according to claim 58, wherein an 
encoded video signal for a right-eye signal of a 
three-dimensional video signal is used as at least 
the first video stream, and an encoded video signal 
for a left-eye signal of the three-dimensional video 

30 signal is used as at least the second video stream, 
an identifier being recorded on the optical disk indi- 
cating a recording area where the three-dimen- 
sional video signal is recorded. 

35 75. An optical disk according to claim 58, wherein an 
encoded video signal for a low resolution compo- 
nent of a high resolution video signal is used as at 
least the first video stream, and an encoded vkjeo 
signal for a high resolution component of the high 

40 resolution video signal is used as at least the sec- 
ond video stream, an identifier being recorded on 
the optical disk indicating a recording area where 
the high resolution vkieo signal is recorded. 

45 76. An optical disk recording apparatus for recording a 
prescribed signal on an optical disk, wherein the 
prescribed signal indudes at least a first video 
stream corresponding to a first signal source and a 
second video stream corresponding to a second 

50 signal source, the first video stream indudes a plu- 
rality of first interleave units and the second video 
stream indudes a plurality of second interleave 
units, each of the plurality of first interleave units is 
m-i pieces of GOPs. each of the plurality of secorvi 

ss interleave units Is mg pieces of GOPs, each of the 
plurality of first interleave units corresponds to first 
time informatbn related to reproduction time, and 
each of the plurality of second interleave units cor- 
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responds to second time information related to 
reproduction time. 

77. An optical disk recording apparatus according to 
claim 76, further comprising video signal division 
means for dividing a high resolution video signal 
into a low resolution component and a high resolu- 
tion component, wherein: 

the first video stream recorded on the optical 
disk represents the low resolution component, 
and 

the second video stream recorded on the opti- 
cal disk represents the high resolutkm compo- 
nent 

78. An optical disk recording apparatus according to 
daim 77, wherein the vkleo signal division means 
generates the low resolution component by a sum 
calculation of specific two or more signals of the 
high resolution video signal and generates the high 
resolution component tsy a difference calculation of 
specrfic two or more signals of the high resolution 
video signal. 

79. An optical disk recording apparatus according to 
claim 78. wherein the vkleo signal division means 
divides the video signal into a vertical lew resolutk>n 
component and a vertical high resolution compo- 
nent. 

8a An opttoal disk recording apparatus according to 
claim 79, wherein the vkleo signal division means 
locates: 

a result of a first division calculation performed 
on a Pth frame of an input video signal using 
video data of at least a 2Q1h line and a 
(2Q-I-1 }tii line of the input video signal in a 2Qth 
line of the first video stream, 
a result of a second division calculation per- 
formed on a Plh frame of the iiput video signal 
using video data of at least a 2Qth line and a 
(2Q+1}th line of the input video signal in a 2Qlh 
line of the second video stream, 
a result of the first division calculation per- 
formed on a (P+ljth frame of the input video 
signal in a (2ai-1)th line of the first vkleo 
stream, and 

a result of the second division calculation per- 
formed on a (P+1}th frame of the input video 
signal in a (2Qf 1)th line of the second vkleo 
stream, 

P and O being each an integer. 

81. An optk»l disk recording apparatus according to 
daim 77, wherein the video signal division means 
divkles the high resolution video signal into a verti- 



cal low resolution component and a vertical high 
resolution component 

82. An optical disk recording apparatus according to 
s daim 77, wherein the video signal division means 

divides the high resolution video signal into the first 
video stream having a horizontal low resolution 
component and tiie second video stream having a 
horizontal Ngh resolution component. 

10 

83. An optical disk recording apparatus according to 
daim 82. wherein overlapping field or frame signals 
In a video signal are recorded in an abbreviated 
encoded state, and the optical disk recording appa- 
ls ratus records an identifier indicating tiie abbrevi- 
ated field or frame signal. 

84. An optical disk recording apparatus according to 
daim 77, wherein the apparatus records klentif ica- 

20 tion information indicating a calculation parameter 
used for the division calculation for divkiing a video 
signal. 

85. An optical disk recording apparatus according to 
25 daim 77, wherein a motion vector detection section 

of a video encoding section uses a motion vedor 
detection signal of one of the streams to encode the 
other stream. 

30 86. An optical disk recording apparatus according to 
daim 76, wherein at least the first video stream and 
the second video stream are encoded by a sub- 
stantially klentical signal format 

35 87. An optical disk recording apparatus according to 
daim 86. wherein the substantially identical signal 
format is obtained by encoding an NTSC, PAL or 
SECAI^ signal. 

40 88. An optical disk recording apparatus according to 
daim 76. wherein interleave units corresponding to 
each of first through mth streams are 1st through 
mlh interleave units, the optical disk recording 
apparatus records: 

45 

first reproduction information induding informa- 
tk)n for reprodudng ttie first interleave unit but 
exduding irtfbrmation for reproducing tiie sec- 
ond interleave unit; 
50 second reproduction information including both 

information for reproducing tiie first interleave 
unit and information for reprodudng the second 
interleave units; and 

an identifier for making the second reproduc- 
55 tion information valid. 

89. An optical disk recording apparatus according to 
daim 88, wherein reprodudon information of one 
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interleave unit includes leading position information 
of another interleave unit, wtierein the anotfier 
interleave unit belongs to the same stream as the 
one interleave unit and is the next closest interleave 
unit to the one interleave unit among interleave 5 
units having time information. 

90. An optical disk recording apparatus according to 
daim 89. wherein the apparatus records reproduc- 
tion information of the first interleave unit in a first 10 
table as the first reproduction information, repro- 
duction information of the first interleave unit and 
the second interleave unit in a second table as the 
second reproduction information, and an identifier 
indicating that the first table is valid. is 

91. An optical disk recording apparatus according to 
claim 90, which records a table for seamless repro- 
duction as the first table, a table for non-seamless 
reproduction as the second table, and an identifier 20 
indicating tine seamless reproduction. 

92. An optical disk recording apparatus according to 
daim 76, wherein an encoded video signal for a 
right-eye signal of a three-dimensional video signal 2S 
is used as at least the first video stream, and an 
encoded video signal for a left-eye signal of the 
three-dimensional vkieo signal Is used as at least 
the second video stream, an identifier being 
recorded on the optical disk indicating a recording 30 
area where the three-dimensional video signal is 
recorded. 

93. An optical disk recording apparatus according to 
claim 76, wherein an encoded video signal for a low 3S 
resolution component of a high resolution video sig- 
nal is used as at least the first video stream, and an 
encoded video signal for a high resolution compo- 
nent of the high resolution video signal is used as at 
least tiie second video stream, an identifier being 40 
recorded on the optical disk indicating a recording 
area where the high resolution video signal is 
recorded. 

94. An optical disk according to daim 75, having a 4S 
result of a specific calculation of the identification 
information and disk attribute information inherent 

in a master disk of the optical disk or the optical 
disk. 
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FIG. 2 



(1) Input signal (frame information) 
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FIG. 4 

Progressive/3D picture arrangement information (MADM identifier) 
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FIG. 15 
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FIG, 16 
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FIG. 1 7 



I Operation flowchart of 3D picture reproduction opporotus 
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FIG. 1 9 

C 3D/PG picture loqicol arrangement table is read 
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FIG. 29 
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FIG. 31 

(1) Reproduction data 
of stream A 



(2) Reproduction data 
of stream B 
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